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'OREWORD 


The  Systems  Research  Laboratory  of  the  U.S.  Army  Research  Institute  for 
the  Behavioral  and  Social  Sciences  (ARI)  conducts  manpower,  personnel,  train¬ 
ing,  and  human  performance  research  associated  with  the  development,  acquisi¬ 
tion,  and  operation  of  Army  systems.  The  project  reported  here,  conducted  by 
the  laboratory's  Fort  Hood  Field  Unit,  is  part  of  an  overall  MANPRINT  evalua¬ 
tion  of  the  Single -Channel  Ground  and  Airborne  Radio  System  (SINCGARS)  begun 
in  1982.  SINCGARS  will  replace  all  of  the  Army's  single-channel  combat  net 
radios  and  will  be  the  primary  secure  voice  means  for  short-range  communica¬ 
tions.  The  results  of  the  system  MANPRINT  evaluation  have  led  to  significant 
hardware  and  software  modifications  that  have  effectively  increased  the  oper¬ 
ability  of  the  system. 

The  current  effort  was  part  of  the  Fort  Hood  Field  Unit's  research  task 
"Soldier-System  Considerations  in  Force  Development  Testing,"  and  was  con¬ 
ducted  in  1988  in  conjunction  with  the  U.S.  Army  Test  and  Experimented’'  on 
Command's  "Follow-On"  and  "Early  User"  test-and-evaluations  of  the  SINCGARS 
system.  The  research  concentrated  on  SINCGARS  operator  training  and  on  the 
post- training  decay  of  the  operator's  skills  and  knowledge  over  time.  It 
demonstrates  that  very  substantial  savings  in  time  and  dollars  can  be  achieved 
by  maximizing  the  cost-effectiveness  of  SINCGARS  training  through  research  and 
development. 

The  key  organizations  to  receive  this  report  include  the  Office  cf  the 
Deputy  Chief  of  Staff  of  Personnel,  MANPRINT  Directorate;  the  Traini* g  and 
Doctrine  Command  (TRADOC)  (the  SINCGARS  System  Manager);  the  Communications 
and  Electronics  Command  (the  SINCGARS  Project  Manager);  the  Operational  Test 
and  Evaluation  Agency  (the  SINCGARS  independent  evaluator);  and  the  Test  and 
Experimentation  Command  (the  SINCGARS  testing  agency). 

This  research  was  conducted  in  accordance  with  the  provisions  of  a 
Memorandum  of  Understanding  between  ARI  and  the  TRADOC  Combined  Arms  Test 
Activity  (now  the  Test  and  Experimentation  Command  Combined  Arms  Test  Center) 
dated  7  May  1981. 


EDGAR  M.  JOHNSON 
Technical  Director 
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SINGLE- CHANNEL  GROUND  AND  AIRBORNE  RADIO  SYSTEM  (SINCGARS) 
OPERATOR  TRAINING  EVALUATION 


EXECUTIVE  SUMMARY 


Requirement: 

The  Single -Channel  Ground  and  Airborne  Radio  System  (SINCGARS)  is  replac¬ 
ing  the  Army's  single -channel  combat  net  radios.  Training  evaluation  for 
SINCGARS  was  performed  by  the  U.S.  Army  Research  Institute  for  the  Behavioral 
and  Social  Sciences  (ARI)  in  conjunction  with  two  SINCGARS  tests  conducted  by 
the  Army  Test  and  Experimentation  Command  under  the  auspices  of  the  Army  Oper¬ 
ational  Test  and  Evaluation  Agency:  (a)  the  Follow-On  Operational  Test  and 
Evaluation  (FOTE)  of  the  modified  advanced  development  model  (April-May  1988); 
and  (b)  the  Early  User  Test  and  Evaluation  (EUTE)  of  the  integrated  communica¬ 
tions  security  model  (October-November  1988).  The  objectives  of  the  evalua¬ 
tion  were  the  following: 

1.  To  determine  the  efficiency  of  the  32 -hour  FOTE  operator  training 
course  in  its  expenditure  of  time  (for  both  students  and  instructors) . 

2.  To  evaluate  the  effects  of  shortening  training  from  32  to  24  hours. 

3.  To  relate  operator  critical  task  performance  times  to  testing  cri¬ 
teria  established  by  the  Army  Training  and  Doctrine  Command  (TRADOC) ;  Armed 
Services  Vocational  Aptitude  Battery  scores;  SINCGARS  Learning-Retention  Test 
(SLRT)  scores;  class  size;  student-to-instructor  ratio;  and  student-to-radio 
ratio. 

4.  To  identify  common  post- training  performance  errors  of  operators  and 
weaknesses  in  their  skills  and  knowledge  base. 

5.  To  estimate  post-FOTE  operator  performance  decrement  over  time  (6, 

11,  and  16  weeks),  and  to  validate  previous  studies  of  operator  performance 
decay. 

6.  To  document  the  operators'  evaluation  of  the  quality  of  their  train¬ 
ing  and  training  materials. 


Procedure : 

Biographical  and  other  personnel  data  were  obtained  on  the  FOTE  operat¬ 
ors.  The  operators'  assessments  were  obtained  with  a  training  evaluation 
questionnaire.  Evaluator  observations  were  recorded  as  events  occurred,  and 
the  expenditure  of  class  time  was  documented  on  a  minute-by-minute  basis. 

Operator  performance  measures  (critical  task  times  and  SINCGARS  Learning- 
Retention  Test  (SLRT)  scores)  were  taken  after  FOTE  and  EUTE  training  and  at 
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intervals  up  to  3-1/2  months  after  the  FOTE.  Previous  performance  decay 
results  were  compared  with  the  current  results.  The  effects  of  class  size, 
student-to-radio  ratio,  and  student- to- instructor  ratio  were  evaluated. 
Operator  performance  errors  were  tracked. 


Findings : 

1.  Unused  time:  During  9  hours  (28X)  of  the  32-hour  course,  students 
were  either  idle  or  engaged  in  unrelated  activities.  (This  is  an  extremely 
conservative  estimate  of  the  percentage  of  course  time  not  optimally  used.) 

For  the  students,  unused  course  time  increased  steadily,  ranging  from  7%  the 
first  morning  to  59X  the  last  afternoon.  The  mean  unused  time  for  two  assist¬ 
ing  instructors  was  59X,  varying  from  36X  to  77X  for  half-day  periods. 

2.  TRADOC  performance  criteria:  Critical  task  performance  times  re¬ 
quired  for  passing  the  course  were  extremely  lenient- -averaging  over  three 
times  as  long  as  the  students  needed. 

3.  Training  deficiencies:  Certain  crucial  procedures  were  not  well 
learned  by  some  students . 

4.  Class  size:  Unrelated  to  performance.  Almost  doubling  class  size 
from  22  to  42  produced  no  apparent  negative  effect.  Indeed,  students  in  the 
larger  class  appeared  to  perform  somewhat  better. 

5.  Student/instructor  ratio:  Unrelated  to  performance.  Doubling  stu¬ 
dents  per  instructor  from  7  to  14  had  no  noticeable  effect. 

6.  Student/radio  ratio:  Unrelated  to  performance.  Increasing  the 
student-to-radio  ratio  from  1.7  to  3.2  did  not  reduce  student  performance. 

7.  Course  evaluation  by  students:  The  most  frequent  comment  was  that 
the  training  was  too  long. 

8.  Post- training  performance  decay:  After  about  a  month  of  training 
and  experience,  performance  drops  10  to  15X  during  the  first  6  to  8  weeks 
without  practice  and  about  20X  after  2-1/2  months,  leveling  off  during  the 
third  month. 

9.  Critical  task  performance  times  did  nut  differ  between  the  24 -hour 
EUTE  course  and  the  32-hour  FOTE  course.  This  finding  strongly  suggests  that 
SINCGARS  training  can  be  made  more  cost-effective. 


Utilization  of  Findings: 

Previous  ARI  research  has  yielded  significant  changes  in  SINCGARS  hard¬ 
ware  and  software.  Additional  human- factors  engineering  findings  are  noted  in 
this  report,  but  the  majority  are  reported  earlier  and  not  repeated. 

SINCGARS  training  has  no  formalized  mechanism  by  which  lessons  learned 
are  incorporated  into  future  training.  This  research  suggests  many  ways  in 
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which  the  training  could  be  improved.  Observations  are  presented  that  relate 
to  course  content,  instructional  procedures,  and  the  operator's  manuals. 

The  life-cycle  cost  of  SINCGARS  training  could  reach  nearly  $6  billion. 
Half  of  these  funds  could  be  saved  by  reducing  course  length,  increasing  class 
size  and  students  per  instructor,  and  by  research  and  development  designed  to 
maximize  the  cost-effectiveness  of  the  training. 
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SINGLE -CHANNEL  GROUND  AND  AIRBORNE  RADIO  SYSTEM  (SINCGARS) 
OPERATOR  TRAINING  EVALUATION 


Introduction 

Background 

This  evaluation  is  part  of  the  overall  Manpower  and  Personnel  Integration 
(MANPRINT)  evaluation  of  the  Single-Channel  Ground  and  Airborne  Radio  System 
(SINCGARS)  being  conducted  by  the  U.S.  Army  Research  Institute  (ARI).  The 
evaluation  began  in  1982  with  the  Army's  Initiation  of  operational  testing  on 
the  system.  Much  of  the  current  data  was  collected  in  conjunction  with  the 
Follow-On  Operational  Test  and  Evaluation  (FOTE)  of  SINCGARS,  performed  by  the 
U.S.  Army  Test  and  Experimentation  Command  (TEXCOM)  at  Fort  Sill  during  the 
period  March  to  May  1988.  Tne  remaining  data  were  obtained  throughout  the 
following  months  in  follow-up  efforts  and  during  operator  training  that  took 
place  prior  to  the  Early  User  Test  and  Evaluation  (EUTE)  of  the  SINCGARS 
Integrated  Communications  Security  (ICOM)  model.  The  EUTE  was  also  conducted 
by  TEXCOM;  it  took  place  at  Fort  Hood  in  October  1988. 

The  SINCGARS  model  tested  in  the  FOTE  was  the  Modified  Advanced  Develop¬ 
ment  Model  (MADM) ,  otherwise  known  as  the  "production"  or  "vanilla"  radio. 

The  latter  characterization  is  derived  from  the  fact  that  the  MADM  is  the 
original,  "plain"  version  without  internal  communications  security.  Its 
successor,  the  ICOM  model,  incorporates  additional  communications  security 
(COMSEC)  features  that  obviate  the  use  of  external  COMSEC  equipment  (specifi¬ 
cally,  the  VINSON  TSEC/KY-57). 

The  advent  of  the  ICOM  radio  has  resulted  in  a  curtailed  production  of  the 
MADM  in  anticipation  of  Army-wide  distribution  of  the  ICOM.  (A  small  number 
of  vanilla  radios  were  deployed  in  Korea  prior  to  the  FOTE  under  an  early 
distribution  plan.)  The  operational  similarity  of  the  two  models  is  very 
high.  Hence,  had  the  ICOM  been  used  during  this  evaluation  rather  than  the 
MADM,  similar  findings  would  have  been  anticipated. 


System  Description 

The  SINCGARS  radio  is  a  VHF-FM  receiver-transmitter  developed  and  manufac¬ 
tured  by  ITT  Corporation  (Aerospace/Optical  Division).  The  radio  will  replace 
the  Army's  current  AN/PRC-77  and  AN/VRC-12  series  of  single-channel  combat  net 
ground  radios  and  the  AN/ARC-114  and  AN/ARC-131  aircraft  radios.  The  ground 
radio  is  provided  in  a  backpack  version  (AN/PRC-119)  and  six  different 
vehicle-mounted  versions  (AN/VRC-87  through  92).  The  primary  role  of  SINCGARS 
is  to  provide  secure  voice  transmission  for  the  command  and  control  of  maneu¬ 
ver  forces.  It  will  be  the  primary  means  for  short  range  communications  at 
echelons  below  division  level  and  for  combat  support  and  combat  service 
support  units  throughout  corps  level. 

One  of  the  most  significant  feature  of  SINCGARS  is  its  jam-resistance,  or 
electronic-counter-counter-measure  (ECCM)  mode,  accomplished  by  "frequency- 
hopping."  In  this  mode,  the  radio  changes  transmission  frequency  many  times  a 
second.  All  radios  in  a  net  are  capable  of  hopping  simultaneously  from  one 
frequency  to  another  within  a  prescribed  set  of  many  frequencies  called  a 


hopset.  The  radio  is  also  capable  of  single-channel  (non-frequency-hopping) 
communication,  data  transmission,  and  channel  scanning.  It  has  push-button 
tuning,  a  light-emitting  diode  display,  selectable  power  outputs,  a  whisper 
mode,  an  expanded  frequency  range  (as  compared  with  the  current  radios), 
built-in  test  capability,  and  nuclear  hardening  against  electromagnetic  and 
radiation  effects.  As  noted,  the  ICOM  version  has  additional  COMSEC  features. 


Evaluation  Objectives 

The  evaluation  had  six  primary  objectives: 

1.  To  determine  the  efficiency  of  the  32-hour  FOTE  operator  training 
course  in  its  expenditure  of  time  for  students  and  instructors. 

2.  To  evaluate  the  effects  of  shortening  allotted  training  time  for 
SINCGARS  operators  from  32  to  24  hours. 

3.  To  relate  operator  critical  task  performance  times  to  the  following: 

•  SINCGARS  operator  testing  criteria  established  by  the  U.S.  Army  Train¬ 
ing  and  Doctrine  Command  (TRADOC) 

•  Operator  scores  on  the  Armed  Services  Vocational  Aptitude  Battery 

•  Operator  performance  on  the  SINCGARS  Learning-Retention  Test  (SLRT) — a 
simulated  hands-on  performance  instrument 

•  Class  size 

•  Student-to-instructor  ratio 

•  Student-to-radio  ratio 

4.  To  identify  common  post-training  performance  errors  of  operators  and 
weaknesses  in  their  skills  and  knowledge  base. 

5.  To  estimate  post-FOTE  operator  performance  decrement  over  time  inter¬ 
vals  of  approximately  6,  11,  and  16  weeks  and  to  validate  previous  studies  of 
skills  and  knowledge  decay  in  SINCGARS  operators. 

6.  To  obtain  operator  evaluation,  commentary,  and  suggestions  pertaining 
to  the  quality  of  their  training  and  training  materials. 


Methods  and  Results 

Description  of  Operator  Training  Course  and  Students 


The  one-week  outstation  operator's  course  conducted  in  preparation  for 
the  FOTE  was  developed  by  TRADOC.  It  consisted  of  four  days  of  instruction 
followed  by  a  day  for  individualized  testing.  Instructors  were  from  Fort 
Sill  and  the  Signal  School  at  Fort  Gordon.  The  course  did  not  include  formal 
net  control  station  training  and  retransmission  training,  which  were  taught 
separately  and  not  observed  for  this  evaluation.  Sixteen  classes  (four  at  a 
time)  were  taught  over  a  one  month  period  that  commenced  on  29  February  1988. 
During  each  week,  two  classes  were  conducted  during  the  day  (0800-1630)  and 
two  at  night  (1730-0230)  in  two  classrooms. 
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The  two  classrooms  were  very  similar.  Both  contained  13  radios  and  were 
prepared  to  accommodate  26  students  at  a  time,  2  students  per  radio.  There 
were  12  different  instructors,  3  per  class.  The  total  number  of  students 
taught  during  the  month  was  367 — an  average  of  22.9  students  per  classroom. 
The  actual  number  of  students  in  a  classroom  varied,  however,  from  11  to  42, 
as  shown  in  Table  1.  The  number  of  radios  remained  constant. 


Table  1 

Training  Groups 

Class  Class-  Class 


Number 

Week 

Shift 

room 

size 

1 

1 

Day 

A 

26 

2 

1 

Day 

B 

26 

3 

1 

Night 

A 

21 

4 

1 

Night 

B 

24 

5 

2 

Day 

A 

22 

6 

2 

Day 

B 

26 

7 

2 

Night 

A 

24 

8 

2 

Night 

B 

26 

9 

3 

Day 

A 

25 

10 

3 

Day 

B 

26 

11 

3 

Night 

A 

11 

12 

3 

Night 

B 

11 

13 

4 

Day 

A 

42 

14 

4 

Day 

B 

17 

15 

4 

Night 

A 

26 

16 

4 

Night 

B 

14 

Total: 

367 

Eighty-six  percent  (315)  of  the  students  came  from  units  located  at  Fort 
Sill.  Others  came  in  various  numbers  from  other  military  posts  in  the  United 
States  (Forts  Bliss,  Bragg,  Campbell,  Carson,  Hood,  Lewis,  and  Polk).  (Loca¬ 
tion  of  duty  station  was  unavailable  for  29  students.)  Tables  2-4  present 
student  personnel  data  that  were  obtained  as  variables  that  might  be  useful 
in  evaluating  the  training  results.  Military  rank  was  obtained  from  classroom 
rosters;  military  occupational  specialty  (MOS)  and  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB)  scores  were  obtained  from  records  kept  in  the 
soldiers'  unit  files:  The  EL  score  reflects  the  student's  facility  in  arith¬ 
metic  reasoning,  math  knowledge,  electronics  information,  and  general  science; 
the  GT  score  reflects  a  verbal  composite  and  arithmetic  reasoning;  the  SC 
score  concerns  numerical  operations,  coding  speed,  auto  and  shop  information, 
and  the  verbal  composite. 
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Detailed  observations  were  made  by  ARI  during  two  of  the  16  course  iter¬ 
ations.  Events  and  situations  related  to  the  variables  under  examination  were 
documented  as  they  occurred. 


Table  2 


Student  Body  Descriptors: 

Military  Rank 

Rank 

Frequency 

Percent3 

PV1 

2 

<1 

PV2 

62 

20 

PFC 

26 

8 

CPL/SPA 

13A 

A3 

SGT 

A2 

1A 

SSG 

32 

10 

SFC 

Total 

12 

A 

frequency: 

310 

Note.  Rank  data  were  missing  for  57  students. 

aPercent  of  available  data.  (Available:  367  -  57  *  310.) 


Table  3 


Student  Body  Descriptors:  Primary  MOS 


MOS  Frequency  Percent3 


MOS 

Frequency 

Percent3 

11B 

32 

10 

11C 

39 

13 

13B 

A0 

13 

13E 

15 

5 

13F 

A1 

13 

13N 

11 

A 

15E 

19 

6 

19D 

A 

1 

19E 

18 

6 

21G 

7 

2 

31K 

10 

3 

63B 

5 

2 

63Y 

A 

1 

76C 

5 

2 

76Y 

9 

3 

88M 

5 

2 

Mi sc  .b 

A  2 

1A 

Total 

frequency: 

306 

Note.  MOS  data  were  missing  for  61  students. 

^Percent  of  available  data.  (Available:  367  -  61  =  306.)  ^Miscel¬ 
laneous  MOSs:  the  total  of  miscellaneous  MOSs  that  individually  were 
less  than  one  percent  of  the  available  data. 


A 


Table  4 


Student  Body  Descriptors:  ASVABa  Scores 

Score  Frequency*1  Mean 


Electronics  Repair  (EL)  270  105.7 

General  Technical  (GT)  271  106.2 

Surveillence  &  Communications  (SC)  264  107.6 

aArmed  Services  Vocational  Aptitude  Battery.  ^Available  data. 

ASVAB  scores  were  not  obtained  for  the  rest  of  the  367  students. 


Course  Efficiency  Analysis 


Purpose 


The  purpose  of  this  analysis  was  to  obtain  an  accurate  estimate  of  how 
efficiently  the  basic  SINCGARS  operator  course  used  student  manhours.  The 
only  time  periods  counted  as  inefficient  for  any  student  were  those  during 
which  the  student  was,  for  purposes  of  the  course,  virtually  idle — that  is, 
not  engaged  in  learning-related  activity.  A  certain  amount  of  inefficiency 
is,  of  course,  inherent  in  any  course  of  instruction.  Therefore,  the  objec¬ 
tive  of  the  analysis  was  not  to  imply  that  every  wasted  manhour  can  be  elimi¬ 
nated,  but  to  provide  a  baseline  against  which  future  course  improvements  can 
be  evaluated. 

Course  Characteristics 


Nominal .  Training  was  scheduled  for  four  days.  (On  the  fifth  day  the 
students  were  to  be  tested.)  The  total  number  of  scheduled  course  hours, 
including  lunch  and  study  breaks,  was  34.  The  total  number  of  scheduled 
instructional  hours,  which  excludes  breaks,  was  22  (5.5  hours  per  day).  Daily 
sessions  were  to  extend  from  0800  to  1630  with  four  20-minute  study  breaks 
(two  in  the  morning  and  two  in  the  afternoon)  and  a  lunch  break  of  1  hour  40 
minutes  (from  1130  to  1310).  There  were  to  be  3  instructors,  about  26 
students,  13  radios,  13  operator's  manuals  ( 10-1) ,  and  13  operator's  pocket 
manuals  (10-2) . 

Actual.  The  characteristics  of  the  actual  course  were  very  close  to  the 
nominal  characteristics.  The  primary  discrepancy  was  the  number  of  students, 
which  was  42  rather  than  26,  making  this  particular  class  the  largest  of  the 
16  classes  taught  during  the  month.  A  comparison  of  the  nominal  course 
schedule  and  the  actual  schedule  is  depicted  in  Table  5. 

Procedure 


One  of  the  16  courses  (4th  week,  day  shift,  class  1)  was  observed  in  its 
entirety  and  comprises  the  basis  for  this  analysis.  At  regular  intervals 
(often  as  short  as  one  minute)  the  course  evaluator  recorded  the  number  of 
students  who  appeared  not  to  be  engaged  in  any  course-related  learning 
activity  whatsoever,  either  active  or  passive.  If  it  was  not  obvious  that  a 
student  was  idle,  the  observation  was  not  counted. 


Table  5 


Actual  Versus  Nominal  Course  Parameters 


Day 

Instruction 

(5.5) 

Lunch 

breaks 

(1.7) 

Study 

breaks 

(1.3) 

Total 

(8.5) 

1 

5.6 

1.7 

1.3 

8.6 

2 

5.5 

1.7 

1.4 

8.6 

3 

5.6 

1.5 

1.4 

8.5 

4 

5.2 

1.7 

1.6 

8.5 

Total: 

21.9 

6.6 

5.7 

34.2 

(22.0) 

(6.7)a 

ii 

ii  ^ 
II  <-n 
it  • 

II 

II  w 
ii  m 

ii 

ii 

n 

ii 

(34.0) 

Note.  All  values  are  hours.  Nominal  values  are  given 
In  parentheses. 

discrepancy  is  due  to  rounding  error. 


Similar  observations  were  made  of  the  assisting  class  instructors.  At  any 
given  time,  one  of  the  three  instructors  was  in  charge  of  the  class,  while  the 
other  two  assisted  as  requested  or  as  they  saw  fit.  The  use  of  time  by  the 
instructor  actually  conducting  the  class  was  not  evaluated;  that  is,  it  was 
never  counted  as  inefficient,  regardless  of  the  instructor's  effectiveness. 
However,  a  close  accounting  was  made  of  the  extent  to  which  the  two  assisting 
instructors  participated  in  the  ongoing  instructional  activities.  As  in  the 
assessment  of  student  participation,  the  only  time  counted  as  inefficient  for 
the  assisting  instructors  was  that  during  which  there  was  no  discernible 
instruction-related  effort. 

Efficiency  Results  for  Students 

Figure  1  portrays  the  percentages  of  idle  hours  during  all  half-day  course 
segments.  Two  strong  trends  are  apparent:  The  number  of  idle  student  hours 
increased  (a)  from  morning  to  afternoon  on  each  of  the  four  days  and  (b)  from 
Day  1  through  Day  4  for  both  morning  and  afternoon  sessions.  Indicative  of 
the  strong  increases  in  idleness  as  the  course  progressed  is  the  fact  that  the 
percentages  for  Mornings  2,  3,  and  4  were  each  higher  than  the  overall  per¬ 
centage  for  the  previous  day. 
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Figure  1.  Idle  student  time:  percentage  of  instructional  hours 
unused  by  students.  (M  *  Morning;  A  *  Afternoon;  D  *  All  Day.  Values 
for  all  day  were  calculated  from  morning  and  afternoon  values,  each 
weighted  by  amount  of  time  observed.  The  overall  means  for  M,  A,  and 
D  were  calculated  across  days,  each  day  weighted  by  amount  of  time 
observed.) 


Table  6  is  based  upon  the  distinction  between  classroom  time  and  consumed 
time.  Classroom  time  is  the  instructional  time  provided — literally  the  amount 
of  time  the  students  spent  in  the  classroom.  Consumed  time  is  the  amount  of 
student  time  during  which  at  least  minimal  learning  activity  was  observed. 

The  table  shows  the  effect  of  subtracting  idle  (unconsumed)  time  from  actual 
instructional  time. 
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Table  6 


Instructional 

Hours  Consumed 

by  Students 

Hours 

%  of  actual 

%  of  nominal 

Day 

used3 

time  available^3 

time  available^3 

1 

4.8 

85.7 

87.3 

2 

4.5 

81.8 

81.8 

3 

3.8 

67.9 

69.1 

4 

2.5 

48.1 

45.5 

Overall: 

15.9 

72.6 

72.3 

aThe  values  in  this  column  were  calculated  with  the  formula 
X[(100  -  Y)/100],  where  X  =  the  actual  value  from  the  Instruc¬ 
tion  column  in  Table  5  and  Y  =  the  corresponding  "all  day"  value 
from  Figure  1.  ^See  Table  5. 


In  interpreting  Table  6,  one  must  remember  that  the  difference  between 
classroom  time  and  consumed  time  is  the  amount  of  totally  nonproductive 
student  time.  The  hours-consumed  values  include  all  instructional  time 
''onsumed  regardless  of  its  effectiveness.  Hence,  overall  hours  consumed 
represents  a  rather  conservative  estimate  of  the  amount  of  time  that  basic 
SINCGARS  operator  training  might  be  expected  to  require  if  it  were  conducted 
with  maximal  efficiency.  The  cause  of  most  of  the  non-use  of  instructional 
time  can  be  directly  attributed  to  the  lack  of  structured  activities  for  the 
students. 

A  miscellaneous  finding  of  interest  was  that  idleness  tended  to  increase 
in  proportion  to  the  distance  between  the  students  and  the  front  of  the  room 
(instructor) . 

Efficiency  Results  for  Assisting  Instructors 

It  must  be  stressed  that  no  attempt  was  made  in  the  evaluation  to  assess 
instructor  effectiveness.  The  data  do  not  reflect  the  relative  abilities  of 
the  instructors  involved  in  the  course.  Each  of  them  appeared  genuinely 
dedicated  to  the  goal  of  providing  quality  training  to  their  students. 

Figure  2  for  instructors  is  analogous  to  Figure  1  for  students,  except 
that  the  data  do  not  reflect  time  unused  by  the  instructor  in  charge,  which 
was  minimal.  It  shows  the  percentages  of  unused  instructor  time  for  the 
assisting  instructors  for  each  half-day  session  during  the  first  three  days  of 
the  course.  The  evaluator  did  not  record  observations  pertaining  to  the 
instructors  on  the  fourth  day  because  of  conflicting  requirements;  however, 
the  amount  of  unused  time  on  the  fourth  day  appeared  to  be  as  great  or  greater 
than  on  the  previous  day. 


30  - 


Overall 


Mean  A  *  59-4 
Mean  D  =  58.8 
Mean  M  ■  58.3 


Day  Day  Day 

1  2  3 


Day 

4 


Figure  2.  Idle  assisting-instructor  time:  percentage  of  instruc¬ 
tional  hours  unused  by  assisting  instructors.  (M  *  Morning;  A  * 
Afternoon;  D  *  All  Day.  Values  for  all  day  were  calculated  from 
morning  and  afternoon  values,  each  weighted  by  amount  of  time  observed. 
The  overall  means  for  M,A,  and  D  were  calculated  across  Days  1,  2,  and 
3, each  day  weighted  by  amount  of  time  observed.  Data  for  Day  4  were 
not  recorded.) 


Like  the  pattern  for  students,  the  pattern  for  assisting  instructors 
showed  an  increase  from  Day  1  to  Day  2.  The  3rd  Day,  however,  consisted  of  a 
great  amount  of  loosely  structured  and  unstructured  student  practice,  during 
which  the  instructors  often  mingled  with  the  students  to  answer  questions, 
solve  equipment  problems,  and  so  forth.  Day  4  was  similar  to  Day  3,  although 
perhaps  even  less  structured. 

Table  7  expresses  the  results  for  assisting  instructors  as  the  amount  of 
instructor  time  that  involved  at  least  minimal  instructional  activity, 
irrespective  of  its  extent  or  effectiveness.  It  is  evident  from  the  table 
that  almost  60  percent  of  the  assisting  instructors'  time  was  not  utilized. 

As  was  true  for  the  student  data,  these  data,  taken  as  an  estimate  of  the 
amount  of  time  used  ineffectively,  are  conservative.  Furthermore,  it  is 
likely  that  instructor  utilization  would  be  even  less  efficient  in  smaller 
classes,  where  it  is  expected  there  would  be  less  demand  for  their  services. 
This  hypothesis  would,  however,  have  to  be  tested. 
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Table  7 


Instructional  Hours  Utilized  by  Assisting  Instructors 


Day 

Hours 

used3 

%  of  actual 
time  available^3 

%  of  nominal 
time  available 

1 

4.3 

38.4 

39.1 

2 

2.7 

24.5 

24.5 

3 

6.8 

60.7 

61.8 

4 

(Unrecorded) 

na 

na 

Overall^: 

13.6 

40.7 

41.2 

Calculated  from  the  formula  X[(100  -  Y)/100],  where  X  =*  hours 
available  (see  note  b)  and  Y  =  the  corresponding  percentage  from 
the  corresponding  "all  day"  value  from  Figure  2.  ^Eleven  hours 
available  per  day  (5.5  hours  per  instructor).  cSee  Table  5. 
^First  three  days  only. 


Post-Training  Testing: 
Criterion  Test  (Final  Exam) 


Procedure 


At  the  end  of  the  32-hour  block  of  basic  operator  training,  all  students 
were  given  two  performance  tests.  The  first,  the  criterion  test,  was  part  of 
the  official  TRADOC  training  materials  and  was  administered  individually  by 
the  instructors.  On  the  average,  the  test  required  about  25  minutes  to 
complete.  Actual  administration  times  varied  from  student  to  student  as  a 
function  both  of  the  skill  of  the  student  and  the  administrative  style  of  the 
instructor  (some  instructors  conducted  the  procedure  faster  than  others). 

The  test  itself  consisted  of  18  hands-on  performance  tasks.  Each  task  was 
to  be  completed  by  the  student  in  a  prescribed  amount  of  time  and  scored  as  a 
"go"  or  a  "no  go."  The  time  limits,  or  criteria,  were  determined  by  TRADOC 
training  supervisors,  who  based  them  on  estimates  of  the  time  required  for  the 
slowest  students  to  accomplish  the  tasks.  Thus  the  criteria  allowed  ample 
time  for  completing  the  tasks.  The  test,  designed  for  screening  out  only 
those  who  exhibited  very  extreme  performance  shortcomings,  allowed  approxi¬ 
mately  99  percent  of  the  students  to  pass  the  course.  It  is  not  feasible, 
however,  that  99  percent  of  the  students  would  have  been  able  to  complete  all 
of  the  critical  tasks  on  the  criterion  test  without  errors;  therefore,  it  is 
assumed  that  a  trial-and-error  approach  to  task  accomplishment  occurred.  It 
was  observed  in  some  instances  that  some  of  the  instructors  would  provide 
corrective  feedback  to  students  during  the  testing.  In  this  regard,  it  is 
noted  that  the  practice  of  occasionally  assisting  the  student  who  cannot 
proceed  with  the  test  because  of  a  fatal  error,  does  not  violate  the  objec¬ 
tive  of  eliminating  only  students  with  very  extreme  performance  shortcomings, 
so  long  as  the  instructor  does  not  "pass"  students  who  are  essentially 
Incapable  of  performing  even  at  a  minimal  level. 
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Owing  to  the  go/no-go  nature  of  the  scoring  and  the  liberal  time  limits, 
the  criterion  test  was  not  capable  of  making  distinctions  among  students; 
that  is,  it  did  not  measure  any  dimension  of  performance  quality.  To  provide 
for  such  discrimination,  it  was  arranged  to  have  student  performance  on  the  18 
criterion  tasks  timed.  The  administering  instructors  timed  each  task  perform¬ 
ance  with  a  stopwatch  and  recorded  the  times  on  the  criterion  test  scoring 
sheets.  Students  who  failed  to  perform  a  task  within  the  prescribed  criterion 
time  were  allowed  to  continue  until  the  task  was  completed  or  until  it  became 
obvious  that  the  student  was  essentially  incapable  of  performing  the  task. 

Task  performance  time  thus  became  available  for  use  as  a  criterion  variable  in 
the  current  training  evaluation;  the  data  also  constitute  an  objective  basis 
for  selecting  future  test  criteria. 

A  detailed  breakdown  of  the  18  critical  tasks  performed  by  the  trainees  on 
the  criterion  test  is  provided  in  the  appendix  to  this  report.  It  lists  much 
of  what  the  SINCGARS  trainee  must  learn  in  order  to  operate  the  radio  as  an 
outstation  net  member  and  thus  portrays  the  nature  of  the  course  content. 

Criterion  Task  Performance  Results 


Table  8  shows  the  mean  performance  time  for  each  of  the  18  criterion 
tasks.  The  means  were  calculated  from  the  individual  performance  times  of  all 
students  who  took  the  test  during  the  month  of  basic  operator  training.  It  is 
perhaps  notable  that  the  largest  consumer  of  time  other  than  assembling  and 
disassembling  the  radio  was  task  3,  setting  up  the  associated  external  KY-57 
communications  security  equipment  (VINSON).  Also,  considering  the  basic 
simplicity  of  task  8  (perform  channel  scanning),  task  11  (load  time-of-day) , 
task  13  (set  radio  for  temporary  storage),  task  15  (prepare  to  receive  ERF), 
and  task  16  (store  ERF),  the  corresponding  mean  times  required  suggest  that 
some  students  were  confused  about  correct  operational  procedures  for  these 
tasks . 

The  table  also  shows  a  large  discrepancy  between  the  criterion  times 
established  by  TRADOC  and  the  actual  performance  times.  The  criterion  time 
allotted  for  completion  of  a  given  task  ranged  from  two  to  eight  times  the 
amount  actually  required  to  complete  the  task.  On  the  average,  criterion 
times  were  three  times  as  great  as  the  performance  times.  It  is  evident, 
then,  that  the  criteria,  without  revision,  would  serve  no  practical  purpose  in 
future  testing.  On  the  other  hand,  the  mean  performance  times  could  very  well 
serve  as  a  rough  guideline  for  establishing  new  criteria.  What  is  needed  to 
complement  them,  however — besides  replication  in  other  classes  to  assess  their 
reliability — is  validation  data  derived  from  the  performance  of  highly  skilled 
and  experienced  operators,  the  latter  to  serve  as  an  ideal  standard  that 
students  can  be  made  to  strive  for. 

The  mean  total  performance  time  to  complete  all  criterion  tasks  was  about 
12  minutes. 
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Table  8 


Criterion  Task  Performance  Times 


Critical  task 

TRADOC 

criterion 

times 

Mean 

performance 

time 

1. 

Assemble  the  SINCGARS  AN/VRC-90  radio  set 

300 

158 

2. 

Turn  on  &  test  radio 

60 

20 

3. 

Turn  on,  clear,  &  load  TSEC/KY-57  (VINSON) 

180 

59 

4. 

Set  battery  condition 

60 

14 

5. 

Load  manual,  cue,  &  2  single-channel  frequencies 

180 

53 

6. 

Perform  communications  check  on  manual  channel 

120 

21 

7. 

Set  frequency  offset  on  1  channel 

60 

18 

8. 

Perform  channel  scanning  (non-priority) 

120 

36 

9. 

Load  &  store  TRANSEC  variable 

120 

41 

10. 

Load  &  store  2  hopsets 

120 

46 

11. 

Load  time-of-day 

180 

41 

12. 

Perform  communications  check  (frequency  hopping) 

180 

32 

13. 

Set  radio  for  temporary  storage 

60 

8 

14. 

Cue  the  net  control  station 

120 

38 

15. 

Prepare  to  receive  ERF 

60 

17 

16. 

Store  ERF 

120 

15 

17. 

Perform  communications  check  (frequency  hopping) 

60 

13 

18. 

Zero  radio,  set  for  long-term  storage,  & 
disassemble  radio  set 

240 

92 

Mean: 

130 

40 

Note.  Times  are  given  in  seconds. 


Post-Training  Testing: 

SINCGARS  Learning-Retention  Test  (SLRT) 


Procedure 


The  SLRT  is  a  34-item,  paper-and-pencil ,  simulated  hands-on  performance 
test.  It  has  been  used  since  1983  to  measure  relative  skill  and  knowledge 
levels,  and  the  retention  of  those  levels  over  time,  in  SINCGARS  operators. 

It  has  been  shown  that  groups  of  operators  achieve  similar  mean  scores  on  the 
SLRT  administered  in  similar  situations.  In  its  current  version,  it  covers 
seven  critical  operational  skills  and  nine  critical  areas  of  knowledge.  The 
student  circles  appropriate  answers  on  items  of  varied  formats.  Designed  for 
face  validity,  all  of  the  skills  items  and  many  of  the  knowledge  items  simu¬ 
late  the  physical  and  visual  aspects  of  the  real  task;  e.g.,  the  student  is 
asked  to  circle  the  correct  answer  on  a  multiple-choice  item  that  has  the 
physical  appearance  of  one  of  the  controls  on  the  radio,  as  illustrated  in 
Figure  3. 

The  SLRT  was  administered  in  group  sessions  by  the  ARI  evaluator  to  all 
students  in  all  16  classes  immediately  following  their  instructor-administered 
final  examinations. 


The  function  switch  on  the 
radio  looks  like  this: 


r-FCTN-. 

-OFFRXMT 


The  function  switch  is  repre¬ 
sented  like  this  in  the  SLRT: 

<FCTN> 


SQ  OFF 
SQ  ON 
TST 
OFF 


lascassi 


RXMT 

REM 

LD 

LD-V 

Z-A 

STW 


Figure  3.  illustration  of  the  similarity  between  the  physical 
features  of  the  radio  and  their  representation  in  the  SLRT. 


Learning-Retention  Results;  Skills  and  Knowledge  Scores 


Tables  9  and  10  show  the  SLRT  results  for  the  362  students  who  took  the 
test  during  the  month  of  training.  (Five  of  the  original  367  students  were 
lost  because  of  normal  attrition.) 

Of  particular  note  in  Table  9  are  the  following  weak  spots:  testing  the 
radio's  memories  (a  topic  that  needs  special  emphasis  in  the  classroom  because 
of  the  lack  of  appropriate  labeling  on  the  function  switch  and  inadequate 
coverage  in  the  operator's  manual);  electronic-remote-fill  procedures;  and  the 
procedures  for  frequency  offsetting. 

The  knowledge  retention  results  shown  in  Table  10  also  indicate  a  few  weak 
areas,  notably:  setup  for  remote  operation  (remote  operation  was  not 
performed  in  the  classroom);  cold  start  load  for  net  members;  the  display 
Indication  for  the  secondary  TRANSEC  variable  (not  stressed  in  the  classroom); 
and  the  procedure  for  entering  the  late  entry  mode.  The  last  is  especially 
confusing  as  presented  in  the  operator's  manual  and  as  represented  on  the 
keypad  of  the  radio;  therefore,  it  needs  special  emphasis  in  training. 

Overall,  the  students  achieved  71.7  percent  of  the  408  points  possible  on 
the  SLRT.  This  percentage  is  comparable  to  the  mean  percent  (75.4*)  obtained 
across  previous  operational  tests  of  the  SINCGARS  radio,  which  indicates  that 
the  current  students  were  similar  to  previous  students  in  post-training  skill 
and  knowledge  levels.  However,  the  present  students  were  at  some  disadvantage 
because  they  did  not  receive  the  formal  net  control  station  (NCS)  training 
that  the  previous  classes  had  received.  Had  that  training  been  included,  the 
overall  percent  correct  for  the  current  students  may  have  been  slightly 
higher. 


^Calculated  from  SLRT  pretest  data  presented  in  Table  21. 
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Table  9 


Student  Performance  on  the  SLRT:  Operational  Skills 

Mean  %  of  perfect 


Task 

task  score 

1. 

Test  receiver-transmitter  memories 

7.5 

2. 

Load  &  store  TRANSEC  variable  (local 

fill) 

88.2 

3. 

Load  &  store  hopset  (local  fill) 

82.2 

4. 

Load  date  &  time  of  day 

83.3 

5. 

Send  hopset  (ERF) 

57.9 

6. 

Receive  &  storo  hopset  (from  ERF) 

67.9 

7. 

Change  frequency  offset 

64.7 

Note.  For  each  task,  the  student  could  , 

achieve 

a  certain  number 

of 

points.  The  percent  shown  for  a  task 

is  the 

mean  percent  of 

possible  points  achieved  on  the  task  by  the  362  students. 


Table  10 

Student  Performance  on  the  SLRT:  Knowledge  Retention 


Knowledge  area 


Mean  %  of  perfect 
area  score 


1.  Single-channel  frequency  loading 

2.  Use  of  "STW"  (stow)  on  the  function  switch 

3.  Setup  for  single-channel  communications 

4.  NCS  procedure  for  receiving  a  cue  call 

5.  Hopset  &  single-channel  frequency  capacities  of 
receiver-transmitter 

6.  Setup  for  remote  operation 

7.  Cold  start  load  for  net  member 

8.  Secondary  TRANSEC  variable  display  indication 

9.  Entering  late-entry  mode 


Note.  See  note  at  Table  9. 


92.5 
88.3 
94.2 
70.9 

76.1 
65.8 

44.2 

27.5 
56.7 


Learning-Retention  Results:  Common  Operator  Performance  Errors 

The  SLRT  enables  the  tracking  of  many  operational  errors  because  each  step 
of  task  performance  is  recorded  by  the  student.  It  was,  therefore,  possible 
to  ascertain  common  operational  errors.  It  was  not  considered  vital  for  the 
purposes  oi  this  report  to  produce  a  detailed  frequency  distribution  of 
errors;  instead,  the  most  common  important  errors  were  noted  and  are  listed  in 
Table  11.  The  problem  areas  are  seen  to  be  similar  to  those  described  in 
Tables  9  and  10. 
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Table  11 


Frequently  Occurring  Operator  Performance  Errors  on  the  SLRT 
Problem  area  Problem  or  error  description 


1.  Testing  the  Very  few  of  the  operators  knew  how  to  test  the  radio 

memory  of  memory,  accomplished  by  moving  the  function  switch  to  the 

the  radio  Z-A  position.  Typically  they  would  set  the  function 

switch  on  TST  rather  than  Z-A.  [Comment:  The  problem 
here  is  attributable  to  a  human  factors  design  deficiency. 
The  label  on  the  Z-A  position  of  the  function  switch  bears 
no  indication  of  the  memory-test  function.  Consequently, 
the  task  should  be  over-emphasized  in  training.  It  was 
not.] 

Instead  of  pressing  only  H°Ld  to  "load  &  store"  the 
TRANSEC  variable,  either  both  H°Ld  &  Sto/ENT  or  Sto/ENT 
alone  was  pressed.  [Comment:  This  problem  has  the 
potentially  serious  consequence  of  erasing  the  primary 
TRANSEC  variable  from  the  radio.] 

3.  Loading  &  a.  Operators  failed  to  load  the  hopset  by  pressing  the 

storing  H°Ld  key.  Instead,  they  would  attempt  to  store  it 

hopsets  directly  into  a  particular  channel  with  Sto/ENT  6.  a 

channel  number.  [Comment:  Ideally,  the  radio  should 
request  the  appropriate  information  via  the  display  once 
the  operator  has  specified  the  desired  procedure.  Since 
the  radio  is  not  interactive,  training  should  emphasize 
the  distinction  between  "loading”  and  "storing"  (or 
"entering"),  terms  that  can  be  easily  misunderstood  or 
confused . ] 

b.  Operators  pressed  the  Sto/ENT  &  channel  number  keys  in 
reverse  order  (channel  number  followed  by  Sto/ENT)  when 
attempting  to  store  a  hopset.  [Comment:  Normal  procedure 
at  a  computer  terminal  is  to  type  information  first,  then 
"enter"  it,  not  vice  versa.  The  correct  procedure  for 
storing  hopsets  in  the  radio  is  to  press  Sto/ENT  first, 
then  the  desired  channel  number,  which  is  opposite  to 
customary  keyboard  procedures.] 

c.  Operators  pressed  both  the  H°Ld  &  Sto/ENT  keys  prior 
to  the  channel  number  in  attempting  to  store  a  hopset 
received  by  ERF  instead  of  just  Sto/ENT  &  the  channel 
number.  [Comment:  This  problem  represents  a  confusion 
between  the  procedures  for  loading  a  hopset  and  those  for 
a  "cold  start."] 

[Table  continued  on  next  page] 


2.  Loading  & 
storing 
TRANSEC 
variable 


15 


Table  11,  continued 

Frequently  Occurring  Operator  Performance  Errors  on  the  SLRT 
Problem  area  Problem  or  error  description 


4.  Setting  date  a.  Operators  attempted  to  enter  time  without  first 
&  time-of-  storing  (Sto/ENT)  the  date, 

day 

b.  After  storing  (Sto/ENT)  the  date,  operators  attempted 
to  set  the  time  without  pressing  the  TIME  key. 


5.  ERF 

procedures 


Operators  set  the  channel  switch  to  MAN  to  receive  or  send 
a  remote  fill. 


6.  Setting  a.  Operators  entered  "05"  instead  of  "5." 

offset 

frequency  b.  Operators  attempted  to  enter  an  offset  without  first 

clearing  the  display. 

c.  Operators  mislocated  the  minus  sign  (SEnd/OFST  key)  in 
the  series  of  key  presses  required  to  load  a  negative 
offset.  The  SEnd/OFST  key  is  pressed  either  before  CLR 
or  after  the  offset  number(s)  instead  of  before  the  offset 
number( s) . 


d.  The  function  switch  was  unnecessarily  set  to  the  LD 
position  before  the  offset  was  entered. 


7.  Differential  The  keys  were  frequently  confused  with  each  other,  espe- 

functlons  of  cially  when  "retrieving"  a  hopset  prior  to  an  ERF — the 

the  Sto/ENT  operator  would  press  Sto/ENT  instead  of  H°Ld. 

&  H°Ld  keys 


8.  Use  of  the 
FREQ  key 


The  FREQ  key  was  sometimes  substituted  for  the  H°Ld  key. 
Apparently,  the  functions  of  the  FREQ  key  were  not  suffi¬ 
ciently  familiar  to  operators. 


Class  Size,  Student-to-Radlo  Ration 
and  Student-to-Instructor  Ratio 


Procedure 


Some  of  the  results  presented  earlier  were  based  upon  observations  made  of 
the  largest  class  taught  during  the  month  of  training.  It  had  42  students, 
whereas  the  other  classes  ranged  in  size  from  11  to  26,  with  an  mean  of  21.7 
(see  Table  1).  Because  of  the  larger  number  of  students  in  the  observation 
class  and  equipment  limitations,  the  student-to-radio  ratio  was  much  larger: 
3.2  students  per  radio  versus  1.7,  on  the  average,  in  the  smaller  classes. 

All  the  classes,  however,  had  three  instructors.  To  compare  the  performance 
of  the  students  in  the  large  and  small  classes,  both  the  criterion  test  scores 
and  the  SLRT  scores  were  combined  for  the  smaller  classes  and  compared  to 
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those  of  the  larger  class.  A  statistical  test  (analysis  of  variance,  general 
linear  model)  was  used  to  compare  the  two  resultant  groups  on  both  the  criter¬ 
ion  test  scores  and  the  SLRT  scores. 

Results 


Table  12  shows  the  mean  times  for  the  criterion  test  and  the  mean  percents 
correct  for  the  SLRT.  (As  noted  earlier,  the  mean  percent  correct  for  all 
classes  combined  was  71.7.)  On  the  criterion  test,  the  large  class  seemed  to 
perform  slightly  better,  although  the  result  could  well  have  been  due  to 
chance.  On  the  SLRT,  the  large  class  again  did  somewhat  better,  and  the 
difference  was  statistically  significant,  although  not  large  in  a  practical 
sense.  Thus,  the  larger  class  suffered  no  performance  loss,  as  one  might  have 
expected;  in  fact,  they  appeared  to  perform  somewhat  better.  These  results 
indicate  that  (within  reasonable  limits)  class  size,  student-to-radio  ratio, 
and  student-to-instructor  ratio  are  probably  not  of  uppermost  importance  for 
SINCGARS  training.  (The  major  differences  between  the  large  class  and  com¬ 
bined  small  classes  in  rank  and  MOS  structure  are  shown  in  Table  13.  ASVAB 
comparisons  were  not  available  for  this  report.) 


Table  12 

Comparison  of  Large  Class  With  Smaller  Classes 


Large  class 
(mean) 

All 

smaller  classes 
(mean) 

Statistical 

significance3 

Criterion  Test 

11.3  minutes 

12.0  minutes 

p  <  .25 

SLRT 

75.7%  correct 

71.1%  correct 

p  <  .02 

aProbability  that 

the  difference 

between  the  large  class 

and  all  of 

the  smaller  classes  combined  was  a  chance  occurrence. 
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Table  13 


Comparison  of  the  Rank  and  MOS  Structures  of 
the  Large  and  Combined  Small  Classes 


Large  class 
(%) 

Combined 
small  classes 
(%) 

Rank 

SFC 

14 

2 

PFC 

2 

9 

PV2 

12 

21 

MOS 

1  IB 

0 

12 

11C 

0 

15 

13F 

49 

8 

13N 

12 

2 

Note .  Shown  are  observations  that  differed 
by  more  than  five  percentage  points  between 
the  large  and  combined  small  classes. 


Correlations  Among  Criterion  Test,  SLRT, 
and  ASVAB  Scores 

Table  14  lists  the  correlation  coefficients  among  the  overall  scores  on 
the  criterion  test,  overall  scores  on  the  SLRT  (total  of  skills  and  knowledge 
subscores),  and  the  ASVAB  variables.  All  of  the  correlations  are  highly 
statistically  significant  (p  <  .0001).  The  highest  correlations  were  between 
the  SLRT  and  the  other  variables. 


Table  14 

Correlations  (Criterion  Test,  SLRT,  and  ASVAB  Scores) 


ASVAB 


SLRT 

- —— 

scores 

EL 

GT 

SC 

Criterion  Scores 

.37 

.26 

.13 

.26 

SLRT  Scores 

•  •  • 

.53 

.41 

.43 

Note.  All  values  are  Pearson  product-moment  correlation 
coefficients . 
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Criterion  Test  Scores,  SLRT  Scores, 
and  Field  Performance  Scores 


Operational  Problems  in  the  Field 

The  top  students  in  the  training  classes  might  be  expected  to  experience 
fewer  operational  problems  in  the  field  than  students  at  the  bottom;  yet,  of 
the  problems  that  would  occur,  they  might  be  expected  to  detect  and  report 
more.  Therefore,  no  prediction  regarding  the  relation  between  classroom 
performance  measures  and  frequency  of  operational  field  problems  was  made. 
And,  in  the  outcome,  neither  the  criterion  test  scores  nor  the  SLRT  scores 
were  at  all  correlated  with  the  number  of  problems  (reported  elsewhere)  the 
operators  later  documented  in  the  field  during  the  FOTE  record-test  phases. 

Operator  Message-Completion  Rates  in  the  Field 


The  successful  communication  of  a  message  in  the  field  over  the  SINCGARS 
radio  is  function  of  many  things.  Nevertheless,  it  was  of  interest  to  deter¬ 
mine  whether  the  criterion  test  scores  and  the  SLRT  scores  were  related  to 
completion  rs'res,  even  though  only  a  small  set  of  data  was  available  (N  *=  28). 
The  criterion  test  scores  were  unrelated  to  message  completion:  the  Pearson 
correlation  coefficient  was  .02,  indicating  essentially  zero  correlation.  The 
correlation  of  message  completion  rate  with  the  SLRT  scores  also  fell  short  of 
statistical  significance,  although  the  coefficient  (.25)  was  somewhat  larger. 
(It  was  necessary  to  achieve  a  correlation  of  .31  in  order  to  be  significant 
at  the  .10  level.)  Although  a  larger  sample  size  may  have  yielded  signif¬ 
icance  in  the  latter  correlation,  the  magnitude  of  the  value  is  not  large 
enough  to  be  of  great  practical  significance. 


Operator  Evaluation  of  Training 


Procedure 


The  Training  Evaluation  Questionnaire  for  Operators  (TEQO)  was  adminis¬ 
tered  to  all  students  in  all  16  classes  at  the  end  of  their  training  following 
the  administration  of  the  SLRT.  The  questionnaire  asked  them  to  rate  the 
training  associated  with  each  critical  operational  task  on  two  five-point 
scales.  The  first  scale  asked  how  confusing  the  training  was,  especially 
during  the  earlier  part  of  the  course;  the  scale  ranged  from  not  confusing  (1) 
to  very  confusing  (5).  The  second  scale  asked  whether  each  task  could  have 
been  learned  faster  had  the  training  been  different  in  some  way;  It  ranged 
from  no  (1)  to  very  much  faster  (5). 

The  TEQO  also  asked  the  students  to  comment  on  what  they  thought  should  be 
added  to  or  eliminated  from  the  course  to  make  it  more  "efficient,  effective, 
or  better." 

Operator  Evaluation  Results:  Rating  Scales 

The  rating  scales  indicated  that  the  students  did  not  perceive  the  crit¬ 
ical  tasks  to  be  confusing  to  learn  or  capable  of  being  learned  a  great  deal 
faster.  The  mean  scores  for  the  critical  tasks  (calculated  across  all 
students)  ranged  from  1.1  to  2.0  for  the  confusion  scale  and  from  1.7  to  2.2 


19 


for  the  faster  scale.  There  is  a  danger  of  misinterpreting  these  results, 
however.  It  was  amply  evident  (see  student  comments,  next  section)  that  many 
of  the  students  felt  the  course  was  too  long,  and  they  offered  many  comments 
concerning  confusion  and  related  topics.  The  appropriate  interpretation  of 
the  results  is  probably  that  the  course  content  was  not  overly  difficult  and 
that  it  was  capable  of  being  learned  in  a  reasonable  amount  of  time. 

Operator  Evaluation  Results:  Student  Comments 

The  students'  written  comments  were  paraphrased  and  organized  into  cate¬ 
gories.  They  are  summarized  in  Tables  15-20.2  The  frequencies  shown  in  the 
tables  should  be  noted  when  evaluating  the  comments.  They  should  not,  how¬ 
ever,  be  understood  as  necessarily  reflecting  the  worth  of  the  comments.  A 
comment  made  by  a  single  respondent  could  be  very  useful. 


Table  15 

Student  Comments  About  Course  Content 

Comment  summary  Frequency 


1.  There  needs  to  be  more  complete  coverage  of  SINCGARS  topics,  24 

such  as:  NCS  procedures;  installation,  assembly,  &  dis¬ 
assembly;  system  configurations;  PMCS;  remote  operations; 

TACFIRE  operations;  retransmission;  data  cueing;  hazards;  & 
maintenance  procedures. 

2.  Instructors  should  not  assume  that  students  have  prior  knowl-  13 

edge  or  experience.  Provide  a  more  basic  introduction  &  over¬ 
view  that  includes  some  basic  radio  operation  coverage  of 

technical  terms,  &  an  introductory  overview  of  the  manual. 

3.  More  attention  needs  to  be  paid  to  the  "why"  of  procedures  in  11 

order  to  aid  retention.  Give  better  explanations,  more 

"theory,"  less  rote  learning. 

4.  Training  on  the  KY-57  should  occur  elsewhere,  not  in  the  4 

SINCGARS  operator  class. 


5.  Place  more  emphasis  on  the  correct  order  of  steps  in  the  var¬ 
ious  operational  procedures.  (This  is  desirable  in  order  to 
overcome  the  sometimes  inconsistent  or  unobvious  steps  that 
must  be  followed  for  some  tasks.] 


2 


2Minor  editorial  notations  by  the  author  are  enclosed  in  brackets. 
Parentheses  are  used  for  parenthetical  material  from  related  student  comments. 
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Table  16 


Student  Comments  About  Instructional  Methods 

Comment  summary  Frequency 


1.  Provide  more  radios  (a  higher  radio-to-student  ratio).  One  36 

radio  per  person. 

2.  Instruction  should  be  more  individualized,  with  an  opportunity  26 

for  some  self-pacing.  Some  students  require  more  work  on  some 
topics  than  others.  There  should  be  a  lower  student-to- 
instructor  ratio.  "Make  the  class  self-paced  instead  of  lock 

step.  So  much  time  was  spent  just  going  over  &  over  things  that 
the  majority  of  the  class  [already  knew],  it  became  redundant  & 
ended  up  more  like  a  detention  hall  than  a  classroom." 

3.  The  course  should  be  more  realistic  in  the  sense  of  providing  25 

a  more  field-like  environment:  more  nets,  NCSs,  and  separa¬ 
tion  among  the  radios;  real  antennas  &  CEOIs.  Conduct  some 
training  with  NCS  operators  in  another  room  to  prevent  ordi¬ 
nary  verbal  communication  among  station  operators. 

4.  The  class  should  be  better  disciplined  with  less  commotion,  20 

less  wasted  time,  &  more  structure.  Rotating  students  for 

hands-on  practice  (while  others  wait)  is  a  waste  of  time. 

There  should  be  less  "filler"  material  in  the  lectures. 

5.  Classes  should  be  smaller.  Use  assisting  instructors  in  sepa-  8 

rate,  smaller  classes.  Sometimes  the  instructors  have  com¬ 
peting  interests,  objectives,  or  methods. 

6.  Night  classes  should  be  eliminated  or  made  shorter.  8 

7.  There  should  be  more  frequent  testing  (of  a  structured  nature)  7 

followed  by  remedial  practice  time. 

8.  Upper  &  lower  ranks  should  be  in  different  classes.  Separate  3 

officers  from  enlisted  &  upper-ranking  enlisted  from  lower- 

ranking  enlisted.  "First  two  days,  the  captain  hogged  RT  & 
did  everything." 

9.  Miscellaneous; 

(a)  The  class  needs  to  be  more  interesting:  "We  played  com-  2 

petition  games  [with  the  radio]  for  a  time.  That  made  it 
interesting,  fun,  &  easier  to  understand  &  hold  the  infor¬ 
mation  taught." 


[Table  continued  on  next  page] 
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Table  16,  continued 

Student  Comments  About  Instructional  Methods 

Comment  summary  Frequency 


(b)  Some  students  acted  as  NCSs,  others  did  not  get  a  chance  2 

— "those  who  didn't  get  to  be  NCS  missed  out  on  a  lot." 

(c)  The  class  should  only  be  for  communications  people  from  2 

the  units.  Once  they  are  taught,  they  can  teach  the  rest 

of  the  unit. 

(d)  Class  rules  should  be  less  childish  &  students  should  2 

receive  less  childish  treatment. 

(e)  The  course  should  start  with  a  taste  of  hands-on.  1 

Students  felt  a  little  frustrated  waiting. 

(f)  Students  were  not  given  adequate  advance  notice  of  SINCGARS  1 

training.  This  caused  inconvenience  in  having  to  change 
personal  plans  at  last  minute. 
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Table  17 


Student  Comments  About  Allocation  of  Course  Time 

Comment  summary  Frequency 


1.  The  course  Is  too  long.  Could  be  cut  by  one  or  more  days.  89 

Material  Is  too  repetitive.  "The  last  two  days  were  spent 

doing  almost  nothing." 

2.  There  should  be  more  structured  [as  opposed  to  free  play]  26 

hands-on  time.  Less  lecture  time. 

3.  The  course  should  be  longer. 3  12 

4.  Miscellaneous: 

(a)  Breaks  should  be  shorter  or  fewer.  5 

(b)  The  pace  was  too  fast.  Students  were  rushed.  3 

(c)  Too  much  time  was  wasted  on  simplistic  matters.  1 

(d)  The  main  instructor  spends  too  much  time  with  individual  1 

students  at  the  cost  of  the  others. 


3considering  the  strong  evidence  that  the  course  should  be  shorter,  this 
comment  may  need  to  be  viewed  within  that  context.  The  students  seemed  to  be 
expressing  the  feeling  of  not  being  familiar  enough  with  the  material  despite 
the  length  of  the  course.  This  may  reflect  more  strongly  on  the  effective¬ 
ness,  or  quality,  of  the  course  rather  than  its  length. 


Table  18 


Student  Comments  About  Manuals  and  Instructional  Aids 

Comment  summary  Frequency 


1.  The  Operator's  Manual  [TM  11-5820-890-10-1,  1  MAR  88]  needs  to 
be  improved:  needs  to  be  better  organized,  to  have  better 
separation  of  sections  ("could  not  tell  when  section 
changed"),  better  arrangement  &  spacing  of  material,  &  clearer 
step-by-step  directions,  etc.  "The  10-1  .  .  .  manual  needs  to 
be  rewritten  [so  the  student  can]  understand  more  about  the 
components.  Instead  of  referring  to  different  pages  or  the 
components'  model  numbers,  the  components  need  names.  The 
10-1  can  be  written  in  steps  on  how  the  SINCGARS  works  without 
reference  to  different  pages  or  other  TM." 

2.  Give  all  students  a  manual  for  reference  &  home  study. 

"Didn't  have  an  opportunity  to  use  manual”;  "never  read 
manual";  "more  manuals";  [etc.]. 

3.  Need  training  films;  more  diagrams  &  illustrations.  Use  a 
large  model  or  mockup  of  the  radio  so  students  can  see  the 
settings  &  follow  procedures.  There  should  be  large  charts  at 
the  front  of  the  room  that  show  the  steps  for  each  operation. 

4.  Provide  handouts  describing  operational  procedures  (the 
manual  doesn't  help  enough).  Need  a  course  notebook  or  sylla¬ 
bus  to  follow  &  use  for  reference.  Shouldn't  rely  on  student 
notes. 

5.  Miscellaneous: 


(a)  The  manuals  need  to  be  used  more  in  class. 

(b)  The  pocket  manual  [TM  11-5820-890-10-2]  needs  to  be 
improved.  Needs  to  be  made  out  of  plastic. 


(c)  The  10-1  &  10-2  manuals  need  to  be  combined:  "Combine 
them  so  the  soldier  will  never  be  confused  [about]  where  to 
look  for  something." 


(d)  The  manual  &  training  should  emphasize  more  strongly 
that  the  radio  should  not  be  operated  with  the  power  amplifier 
unless  the  vehicle  engine  is  running. ^ 


17 


16 


10 


6 


2 

2 

1 


1 


^See  Operator's  Manual,  Special  Instructions,  p.  2-32. 
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Table  19 


Student  Comments  About  Instructors 

Comment  summary  Frequency 

1.  Instructors  need  more  complete  knowledge  of  system.  8 

2.  More  than  one  instructor  in  the  room  sometimes  creates  con-  2 

flicts  among  them.  The  assisting  instructors  may  interrupt 

the  instructor  in  charge. 

3.  Need  military  instructors — not  civilian.  2 


Table  20 

Miscellaneous  Student  Comments  About  Human-Factors  Issues 

Comment  summary  Frequency 

1.  The  W2  RF  cable  is  hard  to  install  &  is  designed  poorly.  2 

2.  The  radios  should  be  raised  or  angled  upward  in  the  classroom  1 

to  make  it  easier  for  students  to  view  the  display  &  controls. 

3.  The  radio  needs  a  speaker  or  headsets.  1 

4.  The  radio  is  too  complicated.  1 

5.  The  front  panel  needs  a  protective  cover  for  field  use.  1 

6.  The  cue  signal  should  be  received  only  by  radios  set  on  FH/M.  1 

7.  The  +4  to  -4  window  for  time  is  not  la-bu  v.nc«feh.  1 

8.  Time  should  not  be  destroyed  by  Z-A.  The  radio  should  have  a  1 

permanent  real-time  clock  with  its  own  battery. 


Evaluator  Observations 

The  findings  reported  in  this  section  are  based  upon  observations  of  the 
training  evaluator  made  during  the  conduct  of  the  training  classes.  Those 
that  involve  human  factors  aspects  of  the  radio  constitute  only  a  small 
fraction  of  the  human  factors  findings  that  pertain  to  SINCGARS.  Human 
factors  findings  are  published  in  earlier  reports  (see  Bibliography)  and  are 
not,  therefore,  repeated  here. 
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Course  Content 


Training  development.  The  SINCGARS  training  package  contains  no  self¬ 
corrective  or  self-improving  loop.  That  is,  there  appears  to  be  no  system¬ 
atic,  formal,  effective  mechanism  whereby  lessons  learned  are  incorporated 
into  future  training  improvements  and  development.  Thus,  some  mistakes  or 
inadequacies  may  be  doomed  to  repeat  themselves  over  and  over  again,  and 
needed  changes  may  not  become  incorporated  into  the  instructional  materials  or 
procedures. 

Net-control-station  training.  The  basic  operator  course  did  not  include 
formal  NCS  training  (including  retransmission  training).  Whether  or  not  it 
would  be  desirable  to  include  the  training  as  a  regular  part  of  the  course  has 
not  been  addressed  in  this  report.  It  is  only  mentioned  here  that  operators 
who  are  familiar  with  those  procedures  may  very  well  be  able  to  function  more 
effectively  as  net  members  and  in  emergency  situations  where  NCS  functions 
must  be  taken  over  by  a  net  member.  A  substantial  number  of  students  pointed 
to  the  lack  as  a  shortcoming  of  the  training. 

Prior  familiarity  with  VINSON.  The  students  in  the  large  training  class 
were  asked  if  they  had  ever  used  the  KY-57  (VINSON)  before.  Approximately  40% 
indicated  that  they  had.  The  percentage  who  were  skillful  in  its  use,  how¬ 
ever,  was  probably  much  smaller.  Whether  this  argues  for  the  inclusion  of 
VINSON  training  with  SINCGARS  training  is  moot;  to  the  extent  that  operators 
(of  the  "vanilla"  radio)  are  not  familiar  with  VINSON,  the  inclusion  of  VINSON 
refresher  training  may  be  required. 

Training  aids.  Attention  needs  to  be  paid  to  the  legibility  of  training 
aids  such  as  overhead  projector  slides.  While  the  large  majority  of  the  27 
view  graphs  used  in  the  present  course  were  adequately  readable,  a  few  were 
borderline  from  a  distance  of  about  twenty  feet,  which  was  about  at  the  back 
row  of  the  class.  Also,  a  number  of  students  made  the  excellent  suggestion 
that  operational  procedures  be  listed  in  steps  on  large  charts  and  placed  at 
the  front  of  the  classroom  during  training.  The  operator's  manuals  are  not, 
as  written,  good  training  aids  (although  the  smaller  of  the  two  Is  better); 
therefore,  the  addition  of  other,  compensating  aids,  such  as  charts  and 
mockups,  should  be  considered. 

Nomenclature .  The  first  practical  exercise  in  the  course  required  the 
students  to  use  the  operator's  manuals  to  identify  the  nomenclature  associated 
with  many  components  of  the  radio  system.  The  students  had  difficulty  finding 
all  of  the  required  information  in  the  manuals.  This  exercise  proved  to  be  a 
very  ineffective  means  of  teaching  a  topic  that,  as  it  later  became  apparent, 
the  instructors  considered  unimportant:  On  the  last  day  of  instruction,  one 
of  the  instructors  said  to  the  class,  "We  could  care  less  about  nomenclature. 
What  we  care  about  is  that  you  can  operate  the  radio."  The  sentiment  was 
laudable,  but  the  remark  brings  into  question  the  utility  of  the  practical 
exercise  dealing  with  nomenclature. 

Radio  transmit  distance.  There  is  general  confusion  about  the  nominal 
transmit  distance  associated  with  the  high  power  setting:  Some  students  were 
told  that  the  distance  is  8  kilometers;  others  were  told  16  kilometers.  The 
manual  says  4  to  16  kilometers. 
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Troubleshooting .  Troubleshooting  is  not  emphasized  in  training.  When 
students  encountered  a  problem,  they  were  shown  how  to  overcome  it  but  rarely 
encouraged  to  track  down  the  cause  of  the  problem  themselves  through  a 
prescribed  systematic  review  of  the  situation  or  by  conducting  appropriate 
tests. 

Instructional  Procedures 

Student/equipment  ratio.  There  was  apparently  little  or  no  detrimental 
effect  of  class  size  and  low  radio-to-student  ratio  in  the  classroom — at  least 
on  criterion  test  performance  and  performance  on  the  SLRT.  This  may  argue 
that  training  can  be  successfully  conducted  with  larger  class  sizes  than  pre¬ 
viously  expected.  However,  caution  must  be  taken  to  maintain  order  and  to 
ensure  that  the  radios  are  distributed  equitably  among  the  students:  It  was 
once  noted  that  while  one  of  the  radios  was  occupied  by  a  single  student, 
seven  other  students  at  the  back  of  the  classroom  were  not  engaged  in  any 
training  related  activity.  Similar  inequities  occurred  from  time  to  time, 
which  subtracted  from  the  amount  of  hands-on  time  for  some  students.  The 
students  made  frequent  comments  indicating  their  desire  for  a  larger  radio-to- 
student  ratio  and  expressing  their  frustration  at  having  to  share  the  equip¬ 
ment  and  learn  at  the  same  time.  It  is  possible  that  the  development  of 
simulated  radios  could  help  to  alleviate  this  problem  at  less  cost  than 
increasing  the  number  of  real  radios. 

Note-taking .  The  students  were  encouraged  to  take  detailed  notes  during 
class.  One  of  the  reasons  was  the  shortage  of  manuals.  Note-taking  in  a 
class  such  as  this  is  an  ineffective  method  of  ensuring  that  the  students  have 
a  record  of  the  instructional  material  presented.  It  would  be  more  effective 
to  prepare  simple,  concise,  handouts  for  any  material  that  would  otherwise  be 
recorded  in  student  notes.  The  handouts  could  be  used  as  preparatory  material 
for  midcourse  tests.  In  this  way,  all  students  would  be  exposed  to  the  same 
information  as  well  as  information  that  did  not  have  to  go  through  the  error- 
inducing  process  of  note-taking.  Note-taking  has  many  disadvantages  and  few 
advantages  that  cannot  be  achieved  by  other  methods.  The  students  did  not 
have,  nor  were  they  provided  with,  adequate  note-taking  materials. 

Intermediate  testing.  There  was  no  effective  midcourse  testing  to  provide 
systematic  and  comprehensive  feedback  to  students  to  enable  them  to  gauge 
their  progress  through  the  course  and  their  preparation  for  the  final  examina¬ 
tion.  One  procedure  that  was  attempted  was  only  mildly  successful:  One 
student  operated  each  radio  while  one  to  three  others  looked  on.  The 
observers  were  instructed  not  to  assist  the  operator  and  to  raise  their  hands 
if  the  operator  made  a  mistake  so  that  one  of  the  instructors  could  assist  in 
making  the  appropriate  corrections.  Not  only  did  the  observers  assist  the 
operator,  contrary  to  instructions,  but  they  would  not  point  out  errors  to  the 
instructors.  So,  while  the  experience  may  have  had  some  value,  it  did  not 
proceed  as  intended. 

Assisting  instructors.  Assisting  instructors  occasionally  compete  with 
the  ongoing  instruction.  Students  who  ask  them  questions  or  who  are  having 
operational  problems  sometimes  become  engaged  in  conversations  or  activities 
with  the  assisting  instructors  that  temporarily  distract  the  student  (and 
possibly  surrounding  students)  from  the  primary  instruction. 


Practical  exercises.  Systematic  monitoring  of  practical  exercises  and 
free-play  practice  periods  during  the  course  was  minimal.  For  the  most  part, 
students  did  not  receive  systematic  individualized  feedback  on  their  perform¬ 
ance  unless  they  requested  it  from  the  instructors  or  encountered  a  problem 
that  prevented  continued  operations. 

Structured  activities,  (a)  While  a  certain  amount  of  experimentation  on 
the  part  of  the  students  should  be  encouraged — in  general,  it  was  not — some  of 
the  students,  intrigued  by  the  novelty  of  the  equipment,  moved  ahead  of  the 
instructor,  involving  themselves  in  operational  activities  that  temporarily 
interfered  with  their  attention  to  the  material  being  presented  by  the 
instructor.  It  is  important,  especially  in  larger  classes,  to  provide  struc¬ 
tured  activities  that  allow  experimentation  and  practice,  but  also  track  the 
ongoing  instruction,  (b)  It  was  noted  on  several  occasions  that  students  who 
were  invited  or  encouraged  by  the  instructors  to  engage  in  hands-on  practice 
with  the  radios  failed  to  do  so.  All  students  should  be  required  to  par¬ 
ticipate  fuxly,  and  hands-on  time  should  be  distributed  equitably  among 
students.  Otherwise,  the  more  aggressive  students  receive  more  practice, 
while  the  more  timid  receive  less  or,  as  was  the  case  with  one  of  the  observed 
students,  almost  none,  (c)  The  lack  of  structure  in  student  activities  is 
generally  wasteful  of  instructional  time,  again,  especially  in  large  classes. 
Most  of  the  idleness  referred  to  earlier  can  be  attributed  to  a  lack  of 
structured  scenarios  for  student  activities. 

Lesson  plans.  The  training  materials  for  the  instructors  included  offi¬ 
cial  lesson  plans.  Adherence  to  the  plans  was  not  strict,  but  all  the  mater¬ 
ial  was  covered.  The  implication  here  is  not  that  the  instructors  should  have 
adhered  more  closely  to  the  plans,  but  that  the  plans  could  be  more  useful  if 
they  exhibited  a  greater  sensitivity  to  classroom  realities  and  provided  for  a 
much  greater  structuring  of  classroom  activities. 

Instructional  setting.  Instructors  should  be  aware  that  the  retention  of 
skills  and  knowledge  learned  in  a  particular  setting  may  suffer  degradation 
when  the  student  is  asked  to  perform  in  a  new  setting.  The  relevance  here  is 
that  the  final  examination  (criterion  testing)  was  conducted  under  very 
familiar  circumstances  for  some  students  (same  room,  familiar  instructor),  but 
somewhat  less  familiar  circumstances  for  others  (different  room,  different 
instructor).  Since  the  criterion  testing  was  not  used  to  eliminate  students 
or  to  make  differential  assessments  of  them,  the  practical  impact  of  such 
variables  was  nil  for  the  FOTE  SINCGARS  operator  training.  It  could,  however, 
have  practical  implications  in  other  situations.  An  attempt  should  be  made  to 
vary  the  instructional  settings  and  circumstances  somewhat  and  to  treat  all 
students  alike. 

Instructional  realism,  (a)  For  most  of  the  course  the  instructors  com¬ 
municated  over  the  radio  in  a  voice  loud  enough  for  the  students  to  hear 
without  a  receiver.  Added  realism  could  be  achieved  by  using  the  radio's 
whisper  mode  and  other  techniques  more  frequently  so  that  students  would  have 
to  employ  the  tool  they  are  learning  to  use  in  order  to  communicate.  There 
were  many  student  suggestions  that  the  course  be  made  more  realistic,  (b) 

Some  exercises  with  the  radio  should  be  conducted  in  darkness  to  familiarize 
students  with  the  difficulties  that  may  be  encountered  operating  at  night, 
especially  with  the  backpack  configuration. 
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catch  on  the  rear  opening  in  the  mounting  adapter  when  the  cable  is  being 
drawn  through  during  installation. 


SINCGARS  Operator  Post-Training  Performance  Decay 
(Review  of  Previous  Findings) 


Decay  Findings:  1983-1984 


The  first  decay  assessment  was  performed  by  ARI  in  association  with  the 
SINCGARS  Maturity  Operational  Test  (MOT),  conducted  by  the  U.S.  Operational 
Test  and  Evaluation  Agency  (OTEA)  during  the  fall  of  1983.  The  assessment 
included  two  primary  samples:  23  cavalry  soldiers  and  27  artillery  soldiers. 
There  were  also  two  other  groups  of  4  cavalry  and  3  artillery  soldiers. 

The  23  cavalry  soldiers  received  extensive  operator  training  and  practice: 
2  weeks  of  classroom  training,  followed  by  1  week  of  unit  training,  followed 
by  3  weeks  of  hands-on  field  practice — a  total  of  6  weeks  of  experience.  The 
SLRT  pretest  was  administered  immediately  after  the  field  practice;  the 
posttest  followed  after  a  no-practice  period  of  3.5  weeks.  The  mean  decrement 
in  performance  level  for  this  highly  trained  group  was  2.0%.  After  an  addi¬ 
tional  28  weeks  of  no  practice,  the  decay  had  increased  to  10%  for  10  of  the 
operators  who  were  still  available  for  testing. 

The  27  artillery  soldiers  received  1  week  of  classroom  training,  1  week  of 
unit  training,  and  2  weeks  of  field  practice.  However,  in  their  case,  the 
SLRT  pretest  was  inserted  between  the  classroom  training  and  the  unit  train¬ 
ing;  the  posttest,  as  before,  was  given  just  after  the  field  practice.  Thus, 
this  group  experienced  additional  practice  between  the  pre-  and  posttests, 
rather  than  a  period  of  no  practice.  Altogether  they  had  4  weeks  of  exper¬ 
ience.  Because  of  the  absence  of  a  programmed  no-practice  period,  it  was 
expected  that  they  would  not  experience  performance  decay  between  the  SLRT 
administrations.  Apparently,  however,  they  did.  The  decrement  in  performance 
level  was  5.2%.  After  27  weeks  of  no  practice,  only  6  operators  remained  from 
this  sample.  Their  decay  had  increased  to  31%. 

The  discrepancy  between  the  cavalry  and  artillery  soldiers  cannot  be 
satisfactorily  explained  because  of  the  large  number  of  uncontrolled  and 
possibly  confounding  variables  associated  with  the  assessment.  The  results  do 
reflect,  however,  that  the  amount  of  decay  is  a  volatile  quantity  that  can  be 
expected  to  vary  in  a  semi-predictable  manner  as  a  consequence  of  natural 
factors  such  as  amount  and  concentration  of  training  and  the  duration  of 
intervals  in  which  the  soldiers  receive  no  SINCGARS  practice. 

The  results  for  the  other  4  cavalry  soldiers  and  3  artillery  soldiers  were 
of  Interest  despite  the  small  sample  sizes.  They  went  through  the  same  series 
of  training  events  as  their  corresponding  larger  groups,  except  that  after  the 
first  week,  they  were  no  longer  exposed  to  the  SINCGARS  radio,  but  were 
switched  to  current  inventory  radios  instead.  Hence,  they  had,  respectively, 

1  and  2  weeks  of  SINCGARS  classroom  experience  followed  by  what  amounted  to 
no-practice  periods  of  7.5  and  8.5  weeks.  They  suffered  mean  losses  of  14.0% 
and  12.6%  in  their  SLRT  scores.  These  two  groups,  who  received  no  post¬ 
training  practice,  may  represent  the  real-world  situation  more  so  than  the 
primary  samples  described  above:  They  received  no  unit  training  or  field 
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experience  immediately  after  official  classroom  training — a  situation  that  is 
expected  to  typify  many  soldiers'  experiences. 

Decay  Findings:  1986-1987 


A  later  decay  study  was  performed  by  ARI  in  1986  in  conjunction  with 
OTEA's  non-developmental  item  (NDI)  test  of  ITT  SINCGARS  and  nine  other  non- 
ITT  radios.  Eleven  combat  arms  soldiers  received  30  hours  of  classroom 
instruction  and  4.5  days  of  field  exercise  prior  to  the  SLRT  pretest.  The 
posttest  followed  after  a  5.5  week  no-practice  period,  during  which  13.5% 
decay  occurred. 

Shortly  after  the  combat  arms  test,  ARI  also  assessed  performance  decay  in 
a  group  of  soldiers  who  had  participated  in  a  special  side  test  conducted  by 
the  SINCGARS  Project  Manager  (PM)  in  association  with  the  Signal  School  at 
Fort  Gordon.  The  29  soldiers,  who  possessed  communications-electronics 
specialties,  were  given  25  hours  of  classroom  training,  followed  by  10  days  of 
no  practice,  followed  by  11  days  of  field  experience,  followed  by  no-practice 
periods  that  differed  from  soldier  to  soldier,  ranging  from  8  to  18  days.  The 
SLRT  pretest  followed  the  second  no-practice  period;  the  posttest  followed  a 
third  no-practice  period  lasting  10  weeks.  The  decay  over  the  third  no¬ 
practice  period  was  4.4%. 

Table  21  summarizes  all  of  the  SINCGARS  operator  learning-retention 
studies  performed  prior  to  the  FOTE. 


Post-FOTE  Performance  Decay 


Procedure 


Operator  performance  level  was  remeasured  with  the  SLRT  at  the  end  of  the 
field  test  phase  of  the  FOTE  and  at  approximately  30,  60,  and  90  days  after 
the  end  of  the  field  test.  Students  from  duty  stations  other  than  Fort  Sill 
were  not  included  In  the  retention  study  because  of  the  logistic  difficulties 
of  retesting  them.  Retesting  was  additionally  limited  to  the  two  (of  seven) 
Fort  Sill  units  that  provided  soldiers  for  the  FOTE  in  the  greatest  numbers: 
The  4/31st  Mechanized  Infantry  Battalion  provided  approximately  195;  the 
2/34th  Field  Artillery  Battalion  provided  approximately  30.  For  each  of  the 
four  retests,  the  two  participating  units  were  requested  to  make  available 
specific  soldiers  whose  names  were  taken,  representatively,  from  alphabetized 
rosters  of  FOTE  participants. 

Table  22  summarizes  the  schedule  of  events  for  this  retention  study  and 
shows  the  numbers  of  soldiers  in  the  various  subgroups.  The  numbers  shown  for 
"Classroom  training”  under  "Subtotal"  represent  the  subject  pool  from  which 
the  retention  study  participants  were  selected. 

Table  22  also  shows  a  26-day  period  (day  85  to  day  110)  of  operator  "expo¬ 
sure"  to  the  radio  following  the  first  SLRT  retest.  During  this  post-FOTE 
period,  OTEA  and  Environmental  Proving  Grounds  personnel  conducted  a 
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Table  21 


Chronological  Summary  of  SINCGARS  Operator  Performance  Decay  Study  Results 


Date: 

1983 

1983 

1983- 

1983- 

1986 

1986- 

1984 

1984 

1987 

Occasion: 

(MOT) 

(MOT) 

(MOT) 

(MOT) 

(NDI) 

(PM) 

Group  type: 

Cava 

Artyb 

Cava 

Artyb 

Cmbt 

Comm 

Armsc 

Elecd 

Evente 

Data 

Classroom  training  (hours): 

80 

40 

80 

40 

30 

25 

SLRT  (pretest) 

Sample  size: 

27 

Score  (%  correct) 

83.9 

No  practice  (weeks): 

2 

Unit/field  training  (weeks): 

4 

3 

1 

2 

No  practice  (weeks) : 

2 

SLRT  (pretest) 

Sample  size: 

4 

3 

23 

11 

29 

Score  (%  correct): 

66.6 

77.1 

76.6 

74 

68 

No  practice  (weeks): 

7.5 

8.5 

3.5 

5.5 

10 

SLRT  (posttest) 

Sample  size: 

4 

3 

23 

27 

11 

29 

Score  (%  correct) 

57.3 

67.4 

75.1 

79.5 

64 

65 

Decay  (%) : 

14.0 

12.6 

2.0 

5.2 

13.5 

4.4 

No  practice  (weeks) : 

28 

27 

SLRT  (posttest) 

Sample  size: 

10 

6 

Score  (%  correct): 

68.9 

57.9 

Decay  (%): 

10.1 

31.0 

»sa>aHB 

BaaaBaaa 

aCavalry.  ^Artillery.  cCombat  Arms,  ^communications  Electronics.  eListed 
in  chronological  order.  Events  that  were  not  applicable  for  particular  groups 
at  particular  times  are  indicated  by  empty  cells. 
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Table  22 


Timeline  for  Post-FOTE  Operator  Performance  Decay  Study 


Number  of  subjects 


Day 

Event 

4/31st  +  2/34th  »  Subtotal  + 

Other 

=  Total 

Classroom  training  and 

SLRT  pretest  phase 

001-004, 

Classroom  training 

76 

6 

82 

15 

97 

005a 

&  SLRT  baseline  test 

008-011, 

Classroom  training 

68 

12 

80 

18 

98 

012b 

&  SLRT  baseline  test 

015-018, 

Classroom  training 

36 

7 

43 

30 

73 

019c 

&  SLRT  baseline  test 

022-025, 

Classroom  training 

0 

3 

3 

96 

99 

026d 

&  SLRT  baseline  test 

Totals: 

180 

28 

208 

159 

367 

Additional  training  phase 

037-039 

Unit  familiarization 

[All  subjects] 

training 

043-068 

Field  training 

[All  subjects] 

(FOTE  pilot  test  & 

field  test  phases) 

SLRT 

retest 

phase 

07  le 

SLRT  retest  1 

19 

4 

n/a 

n/a 

23 

085-110 

Post-training 

[All  subjects] 

exposure  (MINT) 

113* 

SLRT  retest  2 

22 

2 

n/a 

n/a 

24 

1488 

SLRT  retest  3 

11 

0 

n/a 

n/a 

11 

182-183h 

SLRT  retest  4 

13 

8 

n/a 

n/a 

21 

Totals: 

65 

14 

n/a 

n/a 

79 

a04  March 

1988.  bll  March  1988.  c 

18  March  1988. 

d25  March  1988. 

e09  May  1988.  *20  June  1988.  825  July  1988.  b28-29  August  1988. 
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"mutual  Interference"  test  (MINT)  of  SINCGARS  at  Fort  Sill.  The  MINT  used 
most  of  the  operators  who  participated  in  the  FOTE  and  all  of  the  operators 
who  were  subjects  in  this  retention  study.  The  operators  were  exposed  to  the 
radio  on  a  daily  basis  during  the  MINT:  They  turned  it  on  and  remained  close 
by,  but  engaged  in  operational  activities  only  if  problems  occurred  that 
required  manual  manipulation  of  the  controls;  otherwise  the  radio  was  keyed 
automatically  throughout  the  test.  So,  this  period  cannot  be  considered  to  be 
either  additional  training  or  a  genuine  period  of  no-practice.  Indeed,  its 
impact  is  not  known,  but  it  probably  helped  to  maintain  the  operators'  skill 
levels.  Consequently,  the  SLRT  retest  scores  obtained  after  the  MINT  are 
suspected  of  being  somewhat  higher  than  they  would  have  been  without  the  MINT. 
Thus,  the  performance  decay  figures  derived  from  them  may  be  spuriously  low. 

The  SLRT  baseline  test  was  administered  at  four  different  times,  a  week 
apart,  during  the  month  of  classroom  training.  Consequently  the  test-retest 
interval  for  a  given  SLRT  retest  varied  across  students  according  to  the  date 
on  which  they  took  the  baseline  test.  Thus,  each  of  the  four  retest  groups 
itself  consisted  of  four  possible  subgroups,  each  with  a  different  test-retest 
interval.  The  procedure  thus  logically  yielded  16  retention  groups.  The 
actual  number  of  groups  in  the  retention  study,  however,  was  10:  Two  of  the 
logical  groups  were  empty — that  is,  there  were  no  students  in  the  retention 
study  subject  pool  from  the  last  week  of  training  who  were  available  for 
either  the  first  or  third  SLRT  retest  (which  reduced  the  number  of  groups  to 
14);  furthermore  four  groups  were  combined  with  other  chronologically  adjacent 
groups  because  of  small  sample  sizes.  The  10  remaining  groups  are  depicted  in 
Table  23  where  they  are  ordered,  along  with  the  16  logical  groups,  from 
smallest  to  largest  in  terms  of  test-retest  interval. 

Results 


Table  24  presents  the  results  of  the  baseline  and  four  retest  administra¬ 
tions  of  the  SLRT  for  the  10  decay  groups.  The  retest  percentages  have  been 
adjusted  (via  analysis  of  covariance  procedure)  to  remove  the  effects  of 
intergroup  differences  in  baseline  performance.  The  adjusted  percentages  thus 
allow  more  realistic  comparisons  among  the  groups.  All  unadjusted  percentages 
were  derived  by  taking  the  mean  of  individual  percentages  within  the  specified 
group. 

Post-training  performance  decay.  It  was  expected  that  the  highest  SLRT 
performance  levels  would  be  observed  during  retest  1,  just  after  the  field 
training.  At  that  point  the  operators  had  had  not  only  a  week  of  classroom 
training  but  also  another  week  of  unit  familiarization  training  and  three 
weeks  of  intensive  field  training.  To  test  this  hypothesis,  the  data  from 
groups  1,  2,  and  3  (retest  1)  were  combined  and  compared  with  the  combined 
data  (retests  2,  3,  &  4)  of  the  remaining  seven  groups. 

The  difference  between  the  two  resulting  groups  in  mean  percent  correct 
was  tested  for  significance  by  analysis  of  covariance.  The  adjusted  mean 
percent  correct  for  retest  1  (groups  1,  2,  &  3)  was  79.1.  For  retests  2,  3, 
and  4  (groups  4  through  10),  the  corresponding  adjusted  mean  was  63.6.  The 
difference  between  the  two  means  was  statistically  significant:  F(l,  76)  » 
36.09  p  <  .001.  This  decrease  in  performance  level,  which  occurred  during  the 
first  TO  weeks  of  a  3  1/2-month  period  after  the  completion  of  training 
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Table  23 


Design  of  Post-FOTE  Decay  Study 


Logical  groups  Actual  groups 


SLRT 

Comparison 

SLRT 

base¬ 

line 

week3 

Groupb 

Size 

Test-retest 

interval 

(days)  Group 

Size 

Test-retest 
interval 
(mean  days) 

(#1) 

4 

1 

0 

44 

n/a 

n/a 

n/a 

Baseline  vs. 

3 

2 

9 

51 

1 

9 

51 

post-field 

2 

3 

8 

58 

2 

8 

58 

training 

1 

4 

6 

65 

3 

6 

65 

(#2) 

4 

5 

2 

86 —  1 

Baseline  vs. 

3 

6 

9 

93—1- 

— >  4 

11 

91. 7C 

post-MINT 

2 

7 

3 

100—1 

exposure 

1 

8 

10 

107—  I- 

— >  5 

13 

105. 4C 

(#3) 

4 

9 

0 

121 

n/a 

n/a 

n/a 

Baseline  vs. 

3 

10 

2 

128 —  1 

after  no-practice  2 

11 

4 

135—1- 

- >  6 

6 

132. 7C 

period  //I 

1 

12 

5 

142 

7 

5 

142 

(#4) 

4 

13 

1 

155—1 

Baseline  vs. 

3 

14 

5 

162-1- 

- >  8 

6 

160. 8C 

after  no-practice  2 

15 

9 

169 

9 

9 

169 

period  //2 

1 

16 

6 

176 

10 

6 

176 

aThe  4th  week  of  the  training  month  yielded  the  shortest  no-practice  Interval 
for  a  given  retest;  the  3rd  week,  the  next  shortest;  etc.  ^The  group  numbers 
in  this  column  are  not  meant  to  correspond  to  the  class  numbers  given  in 
Table  1.  cCalculated  from  the  intervals  weighted  by  their  sizes. 


experiences,  represents  a  mean  performance  loss  across  groups  4  through  10  of 
approximately  20%.  The  intervening  MINT  exposure  to  the  radio  (see  Table  22) 
suggests  that  this  estimate  of  loss  may  be  conservative. 

Group  decay  differences  within  retests.  As  noted  previously,  each  retest 
session  included  subjects  with  varying  test-retest  intervals  because  the 
baseline  test  was  not  administered  on  the  same  date  for  all  students.  To 
determine  whether  the  observed  performance  differences  among  groups  for  a 
given  retest  were  statistically  significant,  separate  analyses  of  covariance 
were  performed  for  each  retest.  The  analyses  revealed  no  statistically  sig¬ 
nificant  differences  (Table  25),  although  it  should  be  noted  that  the  adjusted 
percentages  generally  decreased  as  the  interval  between  baseline  and  retest 
increased  (see  Table  24). 
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Table  24 


Comparisons  of  SLRT  Baseline  and  Retest  Results 

Mean  percent  correct  (unadjusted  and  adjusted3) 


Retest  1 

Retest  2 

Retest  3 

Retest  4 

(post- 

(post- 

(after 

(after 

Test- 

Base¬ 

line 

% 

field) 

MINT) 

no  practice) 

no  practice) 

Grp 

retest 

interval 

%  <%adj) 

%  (%adj> 

%  (^adj) 

%  (%adj) 

1 

51 

75.3 

80.9  (79.9) 

2 

58 

73.3 

73.8  (75.0) 

3 

65 

65.1 

73.0  (83.5) 

4 

91.7 

79.7 

72.7  (66.8) 

5 

105.4 

71.9 

62.7  (65.5) 

6 

132.7 

81.0 

68.8  (61.4) 

7 

142 

76.2 

59.4  (57.4) 

8 

160.8 

72.3 

61.0  (63.4) 

9 

169 

78.2 

67.3  (63.0) 

10 

176 

68.0 

54.6  (61.8) 

aIn  scoring  the  Individual  student's  SLRT,  the  score  is  expressed  as  a  per¬ 
centage  of  total  points  possible.  Each  of  the  unadjusted  group  percentages 
shown  in  this  table  is  the  mean  of  the  individual  percentages  in  the  specified 
group.  The  adjusted  percentages  have  had  the  effect  of  differential  inter¬ 
group  baseline  performance  statistically  removed. 


Correlation  Between  Length  of  Test-Retest  Interval  and  SLRT  Performance. 
The  Pearson  product-moment  correlation  coefficient  for  the  relation  between 
test-retest  interval  and  group  mean  percent  correct  was  r  =  -.85  (t_[8]  * 

-4.53,  g_  *»  .01  [one-tailed]),  indicating  a  strong  tendency  (coefficient  of 
determination  =  .72)  for  performance  to  decline  during  the  first  two  months. 
This  finding  is  portrayed  in  Figure  4,  which  plots  for  each  retest  the  mean 
individual  SLRT  score  (percent  correct)  for  all  persons  who  took  the  retest 
(irrespective  of  within-retest  test-retest  interval).  By  the  fourth  retest 
the  decay  is  seen  to  level  off.  (Of  course,  it  would  be  expected  to  continue 
at  a  slower  and  slower  rate  as  time  passed.) 
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Table  25 


Covariance  Analysis  of  Within-Retest  Group  Differences 


Retest 

Group 

Mean  %a(jj 
correct3 

Analysis  of 

covariance 

results 

1 

77. 9-- | 

1 

2 

3 

72.6 - > 

79.1 — 1 

F(2,  19)  - 

1.23, 

n  * 

.31 

2 

4 

5 

67.8— 1  . 

66.9— 1““ 

F(l,  21)  = 

0.03, 

p  = 

1.00 

3 

6 

7 

65.7—1  . 

63.1—1 

F(l,  8)  - 

0.12, 

L  * 

1.00 

8 

62.3—1 

4 

9 

62.5—1 - > 

F(2,  17)  = 

0.09, 

P  “ 

1.00 

10 

60.4—1 

aThe  adjusted  means  presented  here  are  somewhat  at  variance 
with  those  show  in  Table  24  because  the  adjustments  here  were 
confined  to  estimates  based  only  upon  the  subgroups  within 
each  retest  group,  whereas  the  adjustments  in  Table  24  were 
based  upon  all  10  groups.  The  latter  therefore  constitute 
better  descriptors. 
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Mean 

SLRT 

% 


80  + 

I  *  (79.1) 


75 

1  1 

+  | 

1  1 

70 

1  1 

+  | 

1  | 

1  i 

1  1 

*  (66.1) 

65 

+  | 

1 

1  1 

|  | 

1 

| 

*  (62.8) 

| 

60 

1  1 

+  1 

1  1 

1 

1 

1 

*  (59.6) 

1 

1 

1 

1 

55 

1  1 

+  1 

1 

1 

1 
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j 
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Figure  4.  SLRT  performance  across  time.  (The  numbers  on  the 
abscissa  in  parentheses  are  the  mean  test-retest  intervals  for 
the  groups  that  participated  in  the  retest.) 


Effect  of  Decreasing  Allotted  Instructional 
Hours  from  32  to  24 


Procedure 


As  noted,  the  FOTE  operator's  course  consisted  of  32  hours  of  training 
plus  8  hours  set  aside  at  the  end  of  training  for  testing.  The  course  did 
not  include  NCS  training.  For  the  EUTE  (fall  1988),  the  duration  of  training 
was  24  hours  (three  days)  plus  testing  on  the  fourth  day.  Since  the  findings 
for  the  FOTE  had  shown  more  than  a  day  of  unused  time,  it  was  hypothesized 

that  the  24-hour  training  course  would  be  as  effective  as  the  32-hour  course. 

The  test  of  this  hypothesis  consisted  of  comparing  across  the  two  courses  the 
mean  post-training  performance  time  for  completing  the  18  critical  tasks. 

The  procedure  for  collecting  the  data  was  identical  to  that  described 
earlier  in  connection  with  the  FOTE  (see  "Post-Training  Testing:  Criterion 
Test  [Final  Exam]).  Differences  in  location  (Fort  Sill  vs.  Fort  Hood)  and 
other  extraneous  variables  were  considered  to  be  of  minor  concern  in  this 
comparison.  The  sample  size  for  the  FOTE  group  varied  slightly  across  criti¬ 
cal  tasks  because  of  missing  data  on  some  of  the  tasks;  it  ranged  from  361  to 

364.  The  sample  size  for  the  EUTE  was  considerably  smaller;  it  was  17. 
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Results 


The  data  are  shown  in  Table  26.  Despite  the  differences  in  sample  size, 
the  differences  for  individual  critical  tasks  were  mostly  quite  small,  and  the 
difference  between  the  two  overall  means  was  negligible  (one  second).  To 
submit  the  latter  difference  to  a  statistical  test  was  considered  fatuous, 
and,  therefore,  no  test  was  conducted.  The  data  as  a  whole  strongly  supported 
the  hypothesis  that  a  24-hour  course  would  be  as  effective  as  a  32-hour 
course. 

Also,  under  the  circumstances,  which  were  largely  uncontrolled,  it  was 
judged  best  not  to  overinterpret  the  observed  differences  in  performance  times 
for  individual  critical  tasks.  It  was  felt  that  no  useful  inferences  based  on 
statistical  significance  or  lack  thereof  would  be  warranted  for  any  given 
difference.  Therefore,  they  were  not  tested. 


Table  26 

Criterion  Task  Performance  Times:  FOTE  (32  Hours  Training)  Versus  EUTE 
(24  Hours  Training) 


FOTE:  Mean 

EUTE:  Mean 

performance 

performance 

Critical  task 

time 

time 

1. 

Assemble  the  SINCGARS  AN/VRC-90  radio  set 

158 

181 

2. 

Turn  on  &  test  radio 

20 

25 

3. 

Turn  on,  clear,  &  load  TSEC/KY-57  (VINSON) 

59 

65 

4. 

Set  battery  condition 

14 

14 

5. 

Load  manual,  cue,  &  2  single-channel  frequencies 

53 

64 

6. 

Perform  communications  check  on  manual  channel 

21 

23 

7. 

Set  frequency  offset  on  1  channel 

18 

15 

8. 

Perform  channel  scanning  (non-priority) 

36 

31 

9. 

Load  &  store  TRANSEC  variable 

41 

30 

10. 

Load  &  store  2  hopsets 

46 

45 

11. 

Load  time-of-day 

41 

31 

12. 

Perform  communications  check  (frequency  hopping) 

32 

13 

13. 

Set  radio  for  temporary  storage 

8 

8 

14. 

Cue  the  net  control  station 

38 

45 

15. 

Prepare  to  receive  ERF 

17 

17 

16. 

Store  ERF 

15 

21 

17. 

Perform  communications  check  (frequency  hopping) 

13 

15 

18. 

Zero  radio,  set  for  long-term  storage,  & 
disassemble  radio  set 

92 

98 

Mean: 

40 

41 

Note 

.  Times  are  given  in  seconds. 
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Discussion  and  Recommendations 


Operator  Performance 

Operator  Performance,  MOSs,  and  the  ASVAB 

The  data  on  MOS  were  provided  to  indicate  general  characteristics  of  the 
subject  sample  for  the  FOTE.  The  relation  between  MOS  and  operator  perform¬ 
ance  was  not  evaluated,  although,  in  all  likelihood,  differences  in  SINCGARS 
performance  would  exist  among  the  many  MOSs  in  the  Army.  The  question  is 
largely  academic,  however,  because  the  SINCGARS  radio  is  a  "general  user 
item,"  which,  in  theory,  all  soldiers  in  the  Army  must  be  able  to  operate 
regardless  of  MOS  or  other  qualification.  As  a  general  user  item,  SINCGARS 
must  not  necessitate  special  operator  prerequisites  beyond  the  SINCGARS 
training  itself — such  as  MOS,  Additional  Skill  Identifiers,  and  Special 
Qualifications  Identifiers.  Because  of  the  general  user  status  of  the  system, 
it  is  incumbent  upon  the  developer  to  ensure  that  its  complexity  is  minimized. 

Similarly,  it  would  not  be  desirable  to  observe  strong  relations  between 
operator  performance  and  aptitude  variables  such  as  those  represented  by 
various  ASVAB  scores,  although,  again,  they  would  undoubtedly  exist  to  a 
degree.  In  this  study,  the  three  ASVAB  scores  examined  (EL,  GT,  and  SC)  were 
only  mildly  related  to  operator  performance  as  measured  by  critical  task 
performance  on  the  SLRT  and  on  the  criterion  tests  (final  exams).  The  most 
general  of  the  three  scores,  GT,  was  least  related  to  performance.  Thus, 
although  the  question  is  complicated  by  sampling  and  validity  factors,  there 
appears  to  be  no  sizeable  relation  to  these  aptitude  measures. 

Operator  Performance,  SINCGARS  Complexity,  and  Human  Factors 

Almost  all  of  the  many  detailed  human  factors  findings  pertaining  to  the 
SINCGARS  system  are  available  In  earlier  reports  (see  Bibliography).  Conse¬ 
quently,  human  factors  was  not  stressed  in  this  evaluation.  It  is  worth 
reemphasizing,  however,  that  the  potentially  huge  training  burden  placed  on 
the  Army  by  SINCGARS  is,  by  and  large,  a  direct  consequence  of  the  lack  of 
sufficient  attention  paid  to  human  factors  variables  during  the  design  and 
development  of  the  system.  The  origin  of  most  of  the  common  performance 
errors,  such  as  those  observed  in  this  study,  can  be  traced,  not  to  a  lack  of 
training,  but  to  an  inordinate  operational  complexity.  As  a  general  user 
item,  SINCGARS  should  be  operationally  uncomplicated. 

The  great  increase  in  complexity  of  this  radio  as  compared  with  its 
precursors  (some  of  which  was  unavoidable,  owing  to  the  far  greater  capability 
of  SINCGARS),  could  have  been  minimized  by  special  concern  for  the  operator- 
system  Interface.  Even  at  this  late  date,  it  would  appear  reasonable  to  take 
another  look  at  the  radio's  display  and  keypad  with  a  eye  toward  simplifi¬ 
cation.  Changes  in  internal  computer  programming  that  would  provide  more 
display  information  (prompts  and  feedback)  to  the  operator  and  reduce  the 
often  confusing  aspects  of  the  keypad  operation  could  reduce  training  time 
significantly.  Additional  labeling  changes  on  the  keypad  could  also  help. 
Training  should  not  be  the  sole  answer  to  solving  the  complexity  problem. 
Training  time  is  money  that  must  be  spent  and  respent  throughout  the  life 
cycle  of  the  system. 
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Operator  Performance  Decay  Over  Time 


The  several  SINCGARS  operator  performance  decay  studies  completed  by  ARI 
over  the  years  were  conducted  in  field  research  settings  in  which  many  rele¬ 
vant  variables  were  uncontrolled.  In  fact,  it  is  precisely  because  of  such 
factors  that  so  many  decay  studies  were  conducted.  The  findings  have  yielded 
values  varying  from  2%  to  31%  for  groups  differing  in  length  of  training, 
experience,  and  no-practice  intervals,  as  well  as  other  possibly  relevant 
variables.  Hence,  it  is  difficult  to  be  entirely  specific  about  the  degree  of 
performance  decrement  expected  after  a  given  period  of  no  practice.  A  reason¬ 
able  generalization  might  be  based  upon  an  unweighted  averaging  oi  all  of  the 
data  from  all  of  the  studies  plus  the  assumption  that  decay  tends  to  level  off 
considerably  after  about  10  weeks.  Such  a  calculation  yields  the  following: 
For  operators  with  approximately  4  weeks  of  training  and  experience  followed 
by  approximately  6  to  8  weeks  of  no  practice,  the  expected  decay  is  approx¬ 
imately  10  to  15%.  Add  a  few  more  weeks  and  the  decay  may  reach  20%  or  more. 
After  this,  performance  would  be  expected  to  decline  more  slowly. 

One  factor  that  further  confounds  SINCGARS  operator  performance  decay  data 
is  the  lack  of  objective  and  independent  measures  of  the  quality  of  operator 
performance.  Thus  the  notion  of  percentage  decay  brings  to  mind  the  question 
"Percent  of  what?"  The  normal,  or  mean,  performance  level  on  the  SLRT  is 
about  75  percentage  points;  a  loss  of,  say,  13  points  would  reduce  the  perfor¬ 
mance  level  to  about  65%  (not  62%).  But  because  there  is,  as  yet,  no  adequate 
measure  of  how  good  75%  is,  it  follows  that  there  is  no  adequate  way  of 
stating  how  bad  65%  or  a  13-point  loss  is. 

About  the  only  insight  into  this  problem  is  the  subjective  realization  of 
ARI  evaluators  and  other  test  personnel  that  operators  fresh  out  of  training 
often  have  difficulty  establishing  frequency-hopping  nets  in  the  motor  pool 
prior  to  going  to  the  field.  Consequently,  additional  practical  instruction 
is  typically  given  after  classroom  training  but  prior  to  the  actual  field 
experience.  Often  this  additional  training  involves  a  week  of  "unit  familiar¬ 
ization,"  and  a  week  of  "pilot  testing."  Both  of  these  events  entail  con¬ 
siderable  experience  beyond  that  provided  in  the  training  course  itself. 

Subjectively,  then,  75%  indicates  a  level  of  post-training  performance 
that  is  lower  than  desirable.  Furthermore,  the  performance  level  appears  to 
be  unrelated  to  the  amount  of  training  typically  received,  as  indicated  in  the 
present  finding  of  no  difference  in  SLRT  performance  after  24  and  32  hours  of 
training.  It  seems,  then,  that  training  needs  not  to  be  longer,  but  better. 


The  Cost  of  SINCGARS  Operator  Training 

It  has  been  unofficially  estimated5  that  the  cost  of  Signal  School  train¬ 
ing  for  one  soldier  for  one  week  is  about  $1,000.  From  this  figure,  and 
certain  assumptions,  it  is  possible  to  derive  a  rough  estimate  of  the  life- 
cycle  cost  of  SINCGARS  operator  training.  It  is  estimated  that  the  outside 
figure  for  that  cost  could  be  as  high  as  $5.6  billion.  The  details  of  this 
estimate  are  shown  in  Table  27. 


5()ffice  of  the  TRAD0C  System  Manager  for  SINCGARS. 
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Table  27 


Calculation  of  SINCGARS  Maximal  Life-Cycle  Training  Costs 


•  Initial  force  training: 

750,000  soldiers 

x  $1,000  each  *  $750,000,000 

•  Plus  first  year  remedial  trailing: 

750,000  soldiers 

x  $300  each  =  225,000,000 

Subtotal  -  975,000,000 

•  Plus  cost  of  training  and  maintaining 
force  for  one  subsequent  year: 

$975,000,000  original  year  cost 

_ x  .25  turnover  factor  =  243,750,000 

•  Plus  cost  of  training  and  maintaining 
force  for  18  remaining  years: 

$243,750,000  cost  per  subsequent 
year 

x  18  remaining  years  in 

life  cycle  -  4,387,500,000 

Total  *  $5,606,250,000 


The  assumptions  upon  which  Table  27  are  based  are  the  following: 

•  The  life-cycle  of  SINCGARS  will  be  20  years. 

•  On  the  average,  there  will  be  750,000  soldiers  in  the  Army  at  any 
given  time  during  the  life  cycle  of  the  radio. 

•  Each  soldier  in  the  Army  will  receive  32  hours  of  operator  training 
(including  testing). 

•  Each  soldier  will  be  given  12  hours  of  remedial  training  per  year. 

•  The  cost  of  remedial  training  per  hour  will  be  the  same  as  that  of 
the  initial  training. 

•  Personnel  turnover  (new  soldiers  coming  into  the  Army)  each  year  will 
be  25%  of  the  full  force,  i.e.,  187,500. 

Certainly  each  of  the  above  assumptions  can  be  challenged,  and  to  the 
extent  that  they  are  modified,  the  entries  in  Table  27  would  have  to  be 
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adjusted.  Regardless,  the  cost  of  SINCGARS  operator  training  would  be  very 
high  even  at  half  the  amount  estimated,  especially  in  comparison  with  costs 
for  the  current  PRC-77  and  VRC-12  series  radios,  which  has  been  estimated  at 
about  6%  of  the  estimate  for  SINCGARS. 


Cost-Effectiveness  Recommendations 


Reduce  currently  allotted  training  time  from  32  to  24  hours. 

By  far  the  mo«t  frequent  complaint  of  the  students  w; -  that  the  training 
course  was  too  long.  But  an  absolute  standard  for  judging  the  efficiency  of  a 
course  in  its  expenditure  of  time  is,  of  course,  not  available.  Despite  this, 
the  finding  that  28%  of  the  FOTE  course  time  for  students  and  59%  for  assist¬ 
ing  instructors  was  essentially  wasted  certainly  suggests  there  is  potential 
for  wonsiderable  improvement  in  cost-effectiveness.  Not  all  of  the  allotted 
instructional  time  is  needed  to  teach  the  current  subject  matter.  The  truth 
of  this  assertion  is  strongly  supported  by  the  adjunct  finding  that  students 
in  a  24-hour  course  (for  the  EUTE)  performed  equally  as  well  on  their  final 
criterion  tests  as  the  students  in  the  32-hour  course  (for  the  FOTE).  The 
students  were  able  to  reach  performance  levels  after  24  hours  that  were  as 
high  as  those  after  32  hours. 

It  makes  sense,  then,  to  pursue  vigorously  the  notion  that  SINCGARS 
operator  training  (including  testing)  does  not  need  to  require  a  full  week  of 
the  soldier's  or  instructor's  time.  Initial  operator  training  could  probably 
be  shortened  to  three  days  rather  than  five  with  no  other  accompanying  changes 
in  format  or  content.  The  simple  requirement  that  the  course  be  conducted  in 
three  days  rather  than  five  would,  if  implemented,  reduce  the  course  by  40% 
with  a  concomitant  reduction  in  costs.  Based  upon  the  maximal  life-cycle  cost 
projected  above,  a  40%  savings  could  amount  to  $2.2  billion,  or  about  $112 
million  per  year.  (See  also  discussion  of  group  measures  of  performance 
below.) 

Maximize  class  size. 

It  was  true  during  the  FOTE  and  EUTE  that  many  variables  with  potential 
effects  upon  course  conduct  and  student  performance  were  uncontrolled — as  is 
normally  the  case  during  operational  testing.  (One  of  the  objectives  of 
operational  testing  is  to  proceed  under  as  realistic  a  set  of  circumstances  as 
feasible.)  It  was  fortuitous,  for  example,  that  the  particular  class  of 
students  observed  during  the  FOTE  was  by  far  the  largest  of  the  16  classes. 

It  was  shown,  however,  that  class  size  seemed  to  have  no  detrimental  effect  on 
learning  and  performance.  Consequently,  it  seems  reasonable  to  increase  class 
size  as  much  as  possible  without  diminishing  returns  in  training  effective¬ 
ness.  The  optimal  size  is,  of  course,  an  empirical  question  that  should  be 
addressed.  The  current  study  logically  suggests  that  class  size  should  be 
maximized,  but  the  confounding  presence  of  three  instructors  per  classroom 
makes  it  difficult  to  suggest  an  optimal  size  without  further  research. 

Maximize  the  student-to-instructor  retio. 


Having  three  instructors  per  classroom  appears  to  be  very  wasteful,  con¬ 
sidering  that  59%  of  the  assisting  instructors'  time  was  unused — even  in  the 
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largest  of  the  classes.  Various  formats  would  be  feasible,  such  as:  (a) 
independent  classes  with  two  or  three  students  per  radio  and  one  instructor; 
and  (b)  two  or  more  related  classes  taught  simultaneously  by  different 
instructors  in  which  students  in  one  could  communicate  with  students  in 
another,  and  instructors  and  students  could  exchange  rooms  or  locations  if 
desired  for  particular  activities  or  segments  of  instruction.  The  relative 
efficacy  of  these  or  other  alternatives  should  be  evaluated  through  appro¬ 
priate  research. 

Maximize  the  student-to-radio  ratio. 

While  it  was  common  for  the  students  to  express  a  desire  for  more  radios, 
it  does  not  necessarily  follow  that  student  performance  would  benefit  by  such 
an  increase  in  equipment.  In  this  study,  it  will  be  recalled,  there  was  no 
obvious  difference  in  performance  between  ratios  of  3.2  and  1.7.  Furthermore, 
the  benefit  must  be  weighed  against  the  cost;  although  even  at  $10,000  per 
radio,  the  cost  might  be  justified  if  significant  performance  benefit  could  be 
demonstrated  in  lower  ratios.  Of  course,  only  so  many  students  can  crowd 
around  a  single  unit,  and  the  subjective  impression  gained  by  the  evaluator  is 
that  four  students  per  radio  borders  on  being  too  many,  while  three  is  satis¬ 
factory.  Again,  the  question  is  an  empirical  one  that  needs  study. 

Expand  the  curriculum  beyond  that  contained  in  the  FOTE  course. 

While  the  insertion  of  additional  topics  of  instruction  into  the  basic 
operator  course  will  not  reduce  the  cost  of  the  course,  it  could  very  well 
make  it  more  effective.  In  favor  of  such  a  notion  is  the  finding  that  the 
24-hour  class  for  the  EUTE  covered  more  topics  than  the  32-hour  FOTE  course, 
apparently  without  a  detriment  to  student  performance.  Apparently  there  is 
room  both  for  a  reduction  in  course  duration  and  added  Instructional  material. 

The  training  should  probably  be  broadened  to  include  basic  coverage  of  NCS 
tasks  for  all  students  regardless  of  whether  they  are  slated  to  become  NCS 
operators  or  outstation  operators.  An  understanding  of  the  NCS  role  should  be 
useful  to  outstation  operators  in  performing  their  own  duties  and  in  under¬ 
standing  the  complexities  of  the  system.  Also,  In  emergency  situations,  net 
members  would  be  more  able  to  take  over  the  role  of  the  NCS  operator.  Other 
topics  that  should  normally  be  taught  include  retransmission  procedures, 
vehicular  installation,  data  transmission,  backpack  configuration,  remote 
operation,  interfacing  with  other  equipment,  and  troubleshooting. 

Establish  a  16-hour  training  goal,  to  be  achieved  through  a  rational  program 
of  research  and  development. 

Beyond  simply  truncating  40%  of  the  course  time,  a  research  and  develop¬ 
ment  program  should  be  implemented  with  the  goal  of  reducing  the  time  require¬ 
ment  even  further.  The  minimization  of  SINCGARS  training  expenditures,  both 
of  time  and  funds,  cannot  otherwise  be  achieved. 

If  a  24-hour  course  can  be  achieved  with  no  training  changes  whatsoever 
(except  a  reduction  in  hours),  it  stands  to  reason  that  further  reductions  in 
training  time  could  be  achieved  with  a  little  effort — that  is,  through 
improvements  in  instructional  methods  and  materials.  It  should  be  recalled 
here  that  the  estimate  of  unused  time  in  the  course  evaluated  for  this  study 
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was  an  estimate  of  completely  unused  time— -not  of  ineffectively  used  time. 

Had  the  estimate  included  time  used  ineffectively  or  non-optimally ,  then,  no 
doubt  it  would  have  been  considerably  larger.  Hence,  there  would  appear  to  be 
considerable  room  for  additional  improvements  that  could  cut  course  time  even 
further. 

The  proposed  research  should  exercise  experimental  control  over  training 
variables  so  that  various  training  formats  and  methods  could  be  adequately 
compared  and  appropriate  instructional  materials  developed.  The  anticipated 
cost  of  the  research  would  be  minimal  in  comparison  with  the  potential 
savings,  which  would  amount  to  another  20%  of  $5.6  billion  if  the  16-hour  goal 
could  be  achieved. 

Such  a  research  program  should  explore  several  areas,  such  as,  but  not 
limited  to,  the  following: 

Increased  classroom  structure.  Classes  should  be  highly  structured,  an 
element  that  was  lacking  to  a  considerable  degree  in  the  present  course.  Part 
of  the  reason  for  this  lack  was  the  excessive  time  allowed  for  a  limited  cur¬ 
riculum.  There  was  simply  nothing  easily  accomplished  and  readily  available 
to  fill  the  time  except  continued  practice  sessions  for  which  no  structured 
activities  had  been  planned.  Those  sessions  were,  therefore,  semiuncontrolled 
in  character,  and  the  usefulness  of  the  time  varied  to  a  great  degree  as  a 
function,  not  of  the  instructors,  but  of  the  students,  some  of  whom  used  it 
beneficially  while  others  wasted  it.  Practice  sessions  should  include  pre¬ 
scribed  activities  in  which  the  students  interact  with  the  system  in  as  real¬ 
istic  a  manner  as  possible.  Nets  should  be  established  that  have  definite 
missions  to  accomplish,  and  a  certain  amount  of  friendly  competition  should  be 
established  among  the  students. 

Individualization  of  training.  Keeping  within  cost  and  time  constraints, 
training  should  be  individualized  as  much  as  possible.  Partially  self-paced 
or  programmed  approaches  should  be  tried .  Related  to  this  issue  is  the 
student-to-instructor  ratio  discussed  above.  The  use  of  more  than  one 
instructor  could  help  to  individualize  instruction,  which  is  one  of  the  main 
thrusts  behind  the  use  of  multiple  instructors.  However,  it  was  obvious  in 
the  present  study  that  the  mere  presence  of  multiple  instructors  does  not 
guarantee  the  efficient  use  of  instructional  time.  The  optimal  number  of 
Instructors  per  classroom  and  the  optimal  number  of  students  per  instructor 
are  questions  that  need  to  be  distinguished,  and  further  research  should 
determine  the  optimum  for  each  variable  consistent  with  maximizing  student 
performance  in  a  cost-effective  manner.  Individualization  of  instruction  must 
be  considered  in  combination  with  other  variables  including  not  only  the 
number  of  instructors  and  class  size,  but  also  instructional  methods  and 
materials. 

Revision  of  the  operator's  manuals.  Being  substantially  unchanged  from 
earlier  versions,  both  of  the  operator's  manuals,  the  10-1  and  the  10-2 ,  con¬ 
tinue  to  need  revision,  especially  the  former. 

Augmentation  of  training  aids.  Training  aids  to  be  considered  should 
include  an  introductory  video  presentation,  simple  handouts,  procedural 
charts,  and  possibly  the  development  of  some  sort  of  simulated  radios  that 
would  minimize  the  number  of  real  (and  costly)  radios  necessary  for  the 
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classroom.  It  Is  also  possible  that  computer  assisted  Instruction  could  be 
developed  that  would  be  beneficial,  perhaps  not  so  much  In  the  classroom  as  In 
military  units  where  remedial  or  refresher  training  Is  required  for  operators 
who  have  not  used  the  equipment  on  a  regular  basis  and  for  new  personnel 
rotating  Into  the  units. 

Development  of  performance  criteria.  The  performance  criteria  provided  by 
TRADOC  for  the  FOTE  and  carried  over  to  the  EUTE  should  be  discarded,  and 
viable  criteria  for  adequate  performance  of  critical  operational  tasks  should 
be  developed.  The  primary  purpose  of  such  criteria  would  not  be  to  fail 
students  who  do  not  meet  them,  but  to  constitute  goals  toward  which  students 
can  strive  and  measures  against  which  instructors  can  gauge  student  progress. 
The  FOTE  performance  times  were  fairly  well  validated  by  those  obtained  during 
the  EUTE  training.  Consequently,  until  further  research  is  done,  weighted 
averages  from  the  two  sets  of  figures  should  constitute  useful  indications  of 
how  fast  the  typical  soldier  will  be  able  to  perform  critical  operational 
tasks.  To  complement  these  criteria,  a  set  of  performance  times  is  needed 
that  is  based  on  the  performance  of  highly  skilled  and  experienced  SINCGARS 
operators.  The  latter  scores  would  represent  a  ceiling  on  performance,  beyond 
which  a  normal  student  would  not  be  expected  to  perform. 

Development  of  group  measures  of  performance.  SINCGARS  testing  has,  to 
date,  been  conducted  in  individual,  hands-on  sessions  in  which  the  instructor 
runs  the  student  through  critical  tasks  and  assigns  a  score  of  "go"  or  "no 
go.”  Needless  to  say,  the  procedure  is  time  consuming.  It  should  be  pos¬ 
sible  to  develop  valid  group  measures  that  could  be  completed  by  the  entire 
class  in  an  hour  or  less.  Such  measures  could  also  be  used  for  intermediate 
testing  during  the  course.  A  good  example  of  such  an  instrument  is  the  SLRT, 
which  was  used  as  a  performance  measure  for  this  study.  Such  a  test,  if 
properly  validated  against  independent  measures  of  performance,  would  be  far 
more  useful  than  the  "go/ no-go"  procedure  currently  in  use.  Not  only  would  it 
be  a  time-saving  device,  it  would  provide  much  more  information  about  the 
student's  performance,  which  could  be  used  as  feedback  to  the  student  and  as 
information  useful  to  the  development  of  performance  norms. 

Increased  course  realism.  The  course  should  strive  for  realism,  espe¬ 
cially  after  the  basics  have  already  been  taught,  by  either  simulating  field 
situations  or  actually  taking  place  in  the  "field"  (motor  pools  or  other 
field-like  environments) .  Appropriate  methods  for  enhancing  realism  need  to 
be  devised. 

Compensatory  training.  Specific  training  steps  should  be  taken  to  over- 
come  equipment  limitations  or  shortcomings,  such  as  human  factors  problems 
cited  here  and  elsewhere.  Many  of  the  common  operator  errors  are  directly 
attributable  to  human  factors  shortcomings.  A  striking  case  in  point  is  the 
inability  of  students,  upon  completion  of  training,  to  test  the  radio's  mem¬ 
ories  because  of  the  lack  of  labeling  on  the  Z-A  position  of  the  function 
switch.  The  task  is  intrinsically  of  minimal  difficulty,  requiring  only  that 
the  operator  move  the  function  switch  into  the  Z-A  position  and  retain  it 
there  long  enough  to  confirm  the  test  in  the  display.  A  simple  but  conscious 
emphasis  by  instructors  on  the  procedure  and  its  usefulness  should  eliminate 
the  problem  easily.  There  are  many  operational  situations  requiring  this  sort 
of  corrective  instruction;  they  are  detailed  to  a  large  extent  in  previous 
human  factors  reports  pertaining  to  the  SINCGARS  system. 
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Appendix  A 


Task  1: 

a. 

b. 

c. 

d. 

e. 

f. 
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Task  2: 
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b. 

c. 

d. 

e. 

Task  3: 
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e. 
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Task  4: 

a. 

b. 

c. 

d. 

e. 


Detailed  Description  of  SINCGARS 
Critical  Performance  Tasks 


Assemble  the  SINCGARS  AN/VRC-90  radio  set: 

Connect  VINSON  (TSEC/KY-57)  cable  CX-13293/VRC  to  receiver- transmitter 
(RT)  RT-1439/VRC. 

Snake  CX-13293/VRC  through  RT  mounting  adapter  AM-7239/VRC. 

Slide  RT  into  adapter  &  seat  it. 

Tighten  left  &  right  holding  screws. 

Connect  W2  cable  from  antenna  connector  to  power  amplifier  J2 
connector. 

Connect  W4  cable  from  J5  connector  on  mounting  adapter  to  AUD/DATA 
connector  on  RT. 

Connect  cable  from  J5  connector  on  RT  to  VINSON. 

Connect  handset  H-250/U  to  J3  connector  on  mounting  adapter. 

Turn  on  &  test  RT: 

Move  function  switch  from  STW  position  to  Z-A  position. 

Observe  "good"  (or  fail  message)  in  display. 

Move  function  switch  to  TST  position. 

Observe  "E...d"  &  ”88888"  in  display;  listen  for  tone  &  clicks,  & 
observe  "good"  In  display. 

Turn  function  switch  to  SQ  ON  position. 

Turn  on,  clear,  &  load  TSEC/KY-57  (VINSON): 

Turn  on  VINSON. 

Turn  MODE  switch  to  £  position. 

Key  H-250/U  to  clear  tone. 

Turn  function  switch  to  LD  position. 

Connect  KYK-13  fill  device  to  VINSON. 

Turn  on  KYK-13. 

Turn  KYK-13  switch  to  position  1. 

Turn  VINSON  switch  to  position  1. 

Key  H-250/U,  observe  KYK-13  for  light  blink,  &  and  listen  for  beep  in 
handset. 

Turn  off  KYK-13  &  disconnect. 

Set  battery  condition  in  RT: 

Set  RT  function  switch  to  LD. 

Press  BATT/CALL  &  observe  *00"  in  display. 

Press  CLR  &  observe  " _ "  in  display. 

Key  in  the  status  numbers  found  on  battery. 

Press  Sto/ENT  &  observe  blink  in  display. 
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Task  5:  Load  manual,  cue,  &  two  single-channel  frequencies  Into  RT: 

a.  Set  function  switch  to  LD. 

b.  With  channel  switch  in  MAN  position,  press  FREQ,  CLR,  &  numbers  of 
desired  frequency. 

c.  Press  Sto/ENT  &  observe  blink  in  display. 

d.  Turn  channel  switch  to  CUE,  press  FREQ,  CLR,  &  numbers  of  desired 
frequency. 

e.  Press  Sto/ENT  &  observe  blink  in  display. 

f.  Set  channel  switch  to  channel  1,  press  FREQ,  CLR  &  numbers  of  desired 
frequency. 

g.  Press  Sto/ENT  &  observe  blink  in  display. 

h.  Set  channel  switch  to  channel  2,  press  FREQ,  CLR,  &  numbers  of  desired 
frequency. 

i.  Press  Sto/ENT  &  observe  blink  in  display. 

Task  6:  Perform  communications  check  on  manual  channel: 

a.  Set  function  switch  to  SQ  ON. 

b.  Set  mode  switch  to  SC. 

c.  Set  channel  switch  to  MAN. 

d.  Depress  P-T-T  switch  on  H-250/U  &  talk  to  NCS. 

Task  7:  Set  frequency  offset  on  one  channel: 

a.  Set  channel  switch  to  desired  channel  &  observe  frequency  in  display. 

b.  Press  SEnd/OFST  &  observe  "00"  in  display. 

c.  Press  CLR  &  observe  " _ "  in  display. 

d.  Press  5  or  10  for  a  positive  offset  (or  press  SEnd/OFST  for  a  negative 

offset  &  observe  "-  _ "  in  display;  then  press  5_  or  10. 

e.  Press  Sto/ENT  &  observe  blink  &  offset  frequency  in  display. 

Task  8:  Perform  channel  scanning  (non-priority): 

a.  Set  function  switch  to  SQ  ON. 

b.  Set  mode  switch  to  FH. 

c.  Set  channel  switch  to  CUE. 

d.  Press  Sto/ENT  &  observe  "SCAnJ'  in  display. 

e.  Press  number  8. 

f.  Press  P-T-T  on  H-250/U  &  observe  channel  number  in  display. 

Task  9:  Load  &  store  TRANSEC  variable  into  RT: 

a.  Set  mode  switch  to  FH. 

b.  Set  function  switch  to  LD-V. 

c.  Set  channel  switch  to  MAN  (or  any  other  channel  except  CUE) . 

d.  Connect  ECCM  fill  device  to  AUD/FILL  connector.  ” 

e.  Turn  on  fill  device. 

f.  Turn  fill  device  switch  to  Tl^  or  T2  as  directed. 

g.  Press  H°Ld/0  on  RT  keyboard. 

h.  Observe  *'L0Ad"  then  "Sto  t"  in  display,  listen  for  beep,  observe 
"Cold"  in  display. 
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Task  10:  Load  &  store  2  hopsets  into  RT: 

a.  Set  function  switch  to  LD. 

b.  Set  mode  switch  to  FH. 

c.  Set  channel  switch  to  MAN. 

d.  Connect  ECCM  fill  device  to  AUD/FILL  connector,  &  turn  on. 

e.  Set  fill  device  select  switch  to  desired  hopset  (e.g.,  1)  &  remain  in 
MAN  channel. 

f.  Press  H°Ld/0. 

g.  Observe  "STO  in  display. 

h.  Press  number  of  desired  channel  (^)  &  observe  "Sto  1”  in  display. 

i.  Press  Sto/ENT  &  observe  blink  in  display  followed  by  hopset  number 
(e.g.,  "F0014') . 

j.  Set  channel  switch  to  channel  1  &  observe  "F001"  in  display. 

k.  Repeat  procedure  for  channel  2. 

Task  11:  Load  time-of-day  into  RT: 

a.  Set  function  switch  to  LD. 

b.  Press  TIME  &  observe  "00"  in  display. 

c.  Press  CLR  &  observe  “ _ "  in  display. 

d.  Press  mission  day  numbers  (01)  &  observe  "01”  in  display. 

e.  Press  Sto/ENT. 

f.  Press  TIME  &  observe  "00  00"  in  display. 

g.  Press  CLR  &  observe  " _ "  in  display. 

h.  Press  time-of-day  (12  00)  based  on  NCS  master  clock  &  observe  "12  00" 
in  display. 

i.  Press  STO/ENT  when  master  clock  is  at  exact  time  (to  the  second). 

Task  12:  Perform  communications  check  (frequency  hopping): 

a.  Set  function  switch  to  SQ  ON. 

b.  Set  mode  switch  to  FH. 

c.  Set  channel  switch  to  channel  1. 

d.  Press  P-T-T  on  H-150/U  &  talk  to  NCS. 

Task  13:  Set  RT  for  temporary  storage: 

a.  Set  function  switch  to  OFF. 

Task  14:  Cue  net  control  station: 

a.  Set  function  switch  to  SQ  ON. 

b.  Set  mode  switch  to  SC. 

c.  Set  channel  switch  to  CUE. 

d.  Turn  off  KY-57. 

e.  Key  H-250/U  handset  for  4  seconds  &  release. 

f.  Wait  15  seconds  for  reply. 

g.  Repeat  if  necessary. 
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Task  15:  Prepare  to  receive  ERF  [ECCM  remote  fill]: 


a.  Set  function  switch  to  LD. 

b.  Set  mode  switch  to  FH. 

c.  Set  channel  switch  to  MAN  &  observe  "Cold”  in  display. 

Task  16:  Store  ERF: 

a.  Observe  SIG  indicator,  listen  for  beep,  &  observe  hopset  number  in 
display;  e.g.,  "HF200.” 

b.  Press  Sto/ENT  &  observe  "Sto  _ *'  in  display. 

c.  Press  channel  number  specified  by  NCS  for  storing  hopset. 

d.  Press  Sto/ENT,  observe  blink  &  “F200"  in  display. 

Task  17:  Perform  communications  check  (frequency  hopping): 

a.  Set  channel  switch  to  channel  containing  hopset. 

b.  Press  P-T-T  on  H-250/U  &  talk  to  NCS. 

Task  18:  Zero  RT,  set  for  long-term  storage,  &  disassemble  radio  set: 

a.  Set  function  switch  to  Z-A  &  observe  "good”  in  display. 

b.  Set  function  switch  to  STW. 

c.  Disconnect  CX-13293/VRC  cable  from  VINSON. 

d.  Disconnect  W2  cable  from  power  amplifier  &  RT. 

e.  Disconnect  W4  cable  from  RT  &  AM-7239/VRC  mounting  adapter. 

f.  Disconnect  H-250/U  from  mounting  adapter. 

g.  Loosen  RT  holding  clamps. 

h.  Pull  RT  &  VINSON  cable  from  mounting  adapter. 

i.  Disconnect  VINSON  cable  from  RT. 
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